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SUMMARY 


From  March  1972  to  December  1974,  the  Institute  for  the  Future  has 
developed  and  released  six  successive  versions  of  a policy-formulation  and 
conferencing  system  for  use  on  the  ARFA  computer  network.  All  programs  were 
written  in  assembly  language  for  a PDF -10  computer  operating  under  TENEX. 

The  two  most  advanced  versions,  known  as  FORUM-5  and  FORUM-6,  are  described 
in  detail  in  the  present  document.  In  addition,  the  design  of  voice  channels 
to  be  used  in  connection  with  computer  conferences  is  discussed. 

The  most  significant  findings  from  this  effort  are  in  the  area  of  the 
development  of  file  structures  to  support  the  complex  interaction  capabil- 
ities described  in  the  report  and  in  understanding  the  human  factors 
group  interaction — as  necessary  for  policy-formulation  activity — through  a 
machine . 


I. 


INTRODUCTION  TO  COMPUTER  CONFERENCING 


Descriptions  of  advanced  societies  by  science-fiction  writers  and  tech- 
nical experts  alike  have  familiarized  us  with  the  concept  of  communication 
systems  which  are  not  bound  by  the  constraints  of  time  and  space.  A cc -raon 
feature  of  these  systems  is  a method  for  instant  idea  exchange  between  -*o- 
ple  separated  by  large  distances.  Not  only  can  one  individual  communicate 
with  another,  but  groups  can  be  brought  into  conferences  by  transporting  the 
images  or  thoughts  of  the  individual  participants  rather  than  their  physi- 
cal bodies. 

Recent  forecasts  of  .industry  trends  agree  with  this  concept  and  project 
important  social  effects.  Electronic  meetings  would  permit  radical  changes 
in  work  patterns  ana  would  alter  the  office  environment  significantly.  In  a 
1971  study  of  broadbc nd  information  services  to  the  home,  Paul  Baran  noted: 

"...going  to  a place  of  work  where  physical  goods  are  transformed 
is  decreasing  in  importance,  as  the  percentage  of  GNP  generated 
by  service  industries  increases;  even  today,  more  GNF  is  derived 
from  service  industries  than  from  manufacturing.  Furthermore, 
with  an  anticipated  reduction  in  working  hours  and  increase  in 
traffic  congestion,  there  will  be  a growing  wish  by  many  to  work 
at  or  near  home  in  lieu  of  going  to  the  'office'."* 

Whether  communication  takes  place  from  the  home  or  a field  office  re- 
mote from  the  central  work  location,  compute r-axsisted  meetings  may  play  as 
important  a role  in  future  planning  and  decision-making  patterns  as  tele- 
phone conversations  have  until  today.  Murray  Turoff,  addressing  the  parti- 
cipants at  the  International  Computer  Communications  Conference  in  1972, 
printed  out: 

"...the  seemingly  straightforward  concept  of  automating  the  con- 
ference call  on  a modern  time-shared  computer  system  offers  a 


*Paul  Baran,  Potential  Market  Demand  for  Two-Way  Information  Services 
to  the  Home,  1970-1980 , Report  R-26,  Institute  for  the  Future  (December 
1971),  p.  14. 
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unique  ability  to  allow  effective  communication  within  larger 
groups  than  would  normally  be  possible  in  a telephone  conference 
call."* 

Revii  ving  these  concepts,  J.C.R.  Lick.lider  defined  tiie  role  the*  compu- 
ter should  play  in  such  interaction.  According  to  him,  the  computer: 

"...could  introduce  a dimension  not  ordinarily  available  in  face- 
tc-fac  * conferences.  It  could  provide  on-line  information  retrie- 
val and  processing  for  example,  retrieval  and  reduction  of  data 
from  on-line  data  bases,  and  dynamic  display  of  models  retrieved 
from  files  of  models  maintained  within  the  network."** 

Taking  as  an  example  the  case  ol  a scientist  who  participates  in  a se- 
ries of  meetings  concerned  with  planetary  science,  Licklider  commented  upon 
the  value  of  teleconferencing  (which  he  defined  as  "interaction  among  geo- 
graphically separated  people  as  though  they  were  together  at  a conference") 
this  scientist  typically: 

"...does  not  like  to  travel;  he  is  interested  in  cutting  down  the 
number  of  meetings  that  ho  has  to  attend  in  Washington.  Perhaps 
more  fundamentally,  he  is  concerned  that  the  thinking  and  planning 
that  goes  on  between  meetings  is  less  effective  than  it  should  be. 
Should  it  not  bo  possible  for  subsets  of  the  committee,  groups  of 
two  or  three  scientists  interested  in  a particular  facet  of  the 
overall  prubl*  n,  to  interact  through  telecommunication  channels? 

Should  it  net  be  possible  for  them,  in  such  interaction,  to  take 
advantage  of  computer-processable  data  bases,  computer-program 
models,  and  packages  of  computer  programs  designed  to  facilitate 
the  kinds  of  calculations  involved  in  the  planning  of  space 
explora  tion? " **  * 

According  to  Turoff : 

"Economics  already  favors  comgjutei  ized  conferencing,  even  for 
fairly  small  groups,  within  organizations  that  have  computers  and 
terminals.  As  mini-system  and  terminal  costs  decline  and  digital 


*Murray  Turoff,  "PARTY-LINK  and  DISCUSSION  Computerized  Conference  Sys 
terns",  in  Stanley  ’Winkler,  ed. , Computer  Communications : Impacts  and  Impli 

cations.  Proceedings  of  the  First  International  Conference  on  Computer  Com- 
munication, Washington,  D.C.  (October  1972),  p.  161. 

** brown , Miller,  and  Keenon,  eds..  Report  of  the  Summer  Study  on  Infor- 
mation Networks  (Now  York:  John  Wiley  & Sons,  1973),  p.  155. 

** *Ibid. , p.  156 . 


data  networks  cone  into  wide  use,  we  should  by  the  late  seventies 
find  this  communication  mode  to  be  quite  commonplace."* 

The  loss  of  tine  and  the  expense  involved  in  traveling  are  not  the  only 
inefficiencies  in  face-to-face  meetings.  They  can  lead  to  decisions  made 
under  pressure,  and  there  is  rarely  an  accurate  record  of  the  conversations. 
Also,  many  potential  contributors  are  excluded  from  these  meetings  by  time 
and  distance  constraints.  Decisions  made  in  face-to-face  situations  often 
leave  participants  with  the  feeling  that  a greater  degree  of  creativity  and 
plain  wisdom  would  have  been  possible  in  an  environment  which  facilitated 
full  communication  and  the  sharing  of  documented  facts. 

Applications  of  computer  conferencing  are  not  limited  to  science.  De- 
cision-makers in  all  fields  often  report  that  tney  spend  too  large  a part  of 
their  time  traveling  to  meetings  and  conferences.  The  energy  shortage  of 
1973/74  lias  dramatized  this  fact  and  has  led  many  to  reconsider  the  need  for 
such  extensive  travel  activities  and  to  search  for  communication  alterna- 
tives. In  the  February  1974  issue  of  Telecommunications , Paul  Polishuk  ad- 
dressed the  question  of  the  possible  savings  in  the  substitution  of  telecom- 
munications for  transportation.  It  would  enable,  he  wrote, 

"...the  employed  population  to  work,  plan,  and  socialize  closer  to 
the  individual  residences  of  the  employees.  Particularly  appeal- 
ing, other  than  as  an  energy  conservation  mechanism,  is  a better 
quality  of  life  for  the  individual  citizen.  Bonus  effects  would 
accrue  in  that  pollution  would  be  lessened  in  the  metropolitan  geo- 
graphic areas,  traffic  congestion  on  main  arterials  into  and  out 
of  met  opolitan  areas  would  be  decreased,  and  less  time  would  be 
consumed  ?n  journeys  to  and  from  work." 

In  early  December  1973,  when  the  Netherlands  was  without  gasoline,  the  news- 
papers reported  that  use  of  the  telephone  increased  by  ten  to  twenty  percent. 
Confirmation  of  such  an  effect  by  accurate  statistics  would  point  to  the  ex- 
istence of  a seriouu  opportunity  for  more  widespread  use  of  electronic  com- 
munications. In  the  military  field,  the  availability  of  transportable.,  geo- 
graphically distributed  management  systems  is  an  obvious  requirement.  Here 
again,  teleconf eienc Lng  could  make  a significant  contribution  to  their 
design. 

*Murray  Turoff',  "Human  Commuriicat ion  via  Data  Networks",  Computer  De- 
cision* (January  J973) , p.  25. 


Although  our  society  claims  to  im  k_  good  use  of  advanced  technology, 
most  decision-making  is  still  taking  p.' ace  through  mechanical  action  rather 
than  through  electronic -equipment  suppoi  t of  intellectual  effort.  Very  lit- 
tle technology  has  been  made  available  until  now  to  unburden  the  manager 
faced  with  cumbersome  communication  problems.  Most  businessmen  travel  every 
day  by  car,  airplane,  and  train  to  go  to  work.  Once  in  the  office,  they 
again  resort  to  mechanical  means  to  make  their  thoughts  manifest:  they  fill 

out  forms,  write  letters  that  have  to  be  typ  i by  physically  hitting  pieces 
of  paper  with  miniature  hammers,  and  they  move  physical,  blocks  of  files  and 
reports  through  the  organization  to  accomplish  visible  results. 

The  efficiency  of  this  type  of  work  decreases  with  distance  between 
workers  much  more  rapidly  than  an  inverse  square  function.  Contact  with 
people  in  the  next  office  involves  a finite  commitment  and  effort.  Con- 
tact with  personnel  in  another  wing  of  the  building  complex  is  certainly 
not  casual.  And  dealing  with  a part  of  the  organization  in  another  city 
calls  for  a range  of  cumbersome  systems,  such  as  the  mail,  the  telephone, 
the  telegraph,  and  transportation. 

It  is  useful  at  this  point  to  recall  some  statistical  facts  of  busi- 
ness activity.  Thorngren  and  Goddard*  have  found  that  12  to  IS  percent  of 
all  external  business  contacts  involved  more  than  two  participants.  Few  of 
these  multiperson  contacts  take  place  by  electronic  communication.  This 
needs  to  be  contrasted  with  the  fact  that  over  80  percent  of  all  two-person 
business  contacts  occur  by  telecommunications . 

In  order  to  improve  the  quality  of  decision-making,  it  is  necessary  to 
modify  the  nature  of  multiperson  communication  and,  in  particular,  to 
change  its  dependence  on  space  to  such  an  extent  chat  thoughts  are  equally 
clear,  equally  well  documented,  and  equally  accessible  no  matter  whit  the 
locations  of  the  author  and  recipient.  Its  dependence  on  time  must  be 
changed  in  such  a way  that  the  pressures  of  travel  schedules  and  the  syn- 
chronization of  attendance  (as  in  face-to-face  and  telephone  conference 
calls)  are  no  longer  important  factors  in  decision  processes. 


*Rep>ortoJ  in  Final  Report,  Volume  3,  Communications  Studies  Group  (Sep- 
tember 197.3)  . 
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In  an  effort  to  compare  computer  conferencing  with  other  modes  of  com- 
munication, we  have  summarized  the  major  parameters  of  interaction  in  four 
major  contexts  in  Figure  1:  face-to-face,  computer  network,  voice,  and 
voice  plus  vide.*.  The  apparent  advantages  of  computer  conferencing  are  (1) 
the  availabilicy  of  an  accurate  record  for  both  review  and  distribution, 

(2)  a tie  to  processing  services,  (3)  the  possibility  of  immediate  display 
of  group  views,  and  (4)  the  possibility  of  anonymity,  which  allows  the  ex- 
pression of  personal  statements  without  group  pressure.  Its  current  draw- 
backs are  (1)  the  lack  of  social  contact  among  participants,  (2)  the  require- 
ment for  typing,  (3)  the  loss  of  visual  information,  and  (4)  the  sensitivity 
of  the  system  to  technical  failure. 

As  early  as  1963,  the  Institute  for  Defense  Analyses  sponsored  research 
into  early  forms  of  teleconferencing  in  the  context  of  high-level  crises. 
Reviewing  teleconferencing  applications  in  use  in  the  United  States  at  that 
time.  Human  Sciences  Research,  Inc.,  noted  that  most  of  the  available  experience 
was  with  telephone  and  teletypewriter  conferences  and  with  closed-circuit 
television;  no  computer  conferencing  was  employed  at  that  time,  but  tele- 
type networks  were  no  longer  novelties.  The  authors  of  the  report  recalled 
that: 

"...the  government  has  experienced  teletypewriter  conferencing  on 
several  past  occasions.  In  the  1948  Berlin  crisis,  a large  volume 
of  teletypewriter  conferencing  occurred."* 

Use  of  the  ordinary  teletype  in  such  interaction  led  to  some  problems,  how- 
ever : 

"The  one  thing  most  emphasized  by  the  State  Department  repre- 
sentative was  the  need  for  administrative  control  on  a teletype 
net.  This  need  for  circuit  discipline  on  teletype  is  particularly 
due  to  the  characteristic  of  the  equipment  that  if  more  than  one 
station  transmits  at  once  the  message  will  be  mutilated."** 

Tnese  remarks  poinu  to  the  need  for  an  environment  that  supports  the  confer- 
encing function  in  multistation  discussion,  provides  a variety  of  flexible 


*Gerald  bailey,  Peter  hordlie,  and  Frank  Sistrunk,  Review  of  Telecom- 
munications Applications  in  ,!se  in  the  United  States,  Institute  for  Defense 
Analyses  (20  September  1963),  pp.  3-18. 


**Ibid. , pp.  3-18. 
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PARAMETERS  OF  COMMUNICATION 

UNAIOED 

FACE-TO-FACE 

NETWORK 

CONFERENCING 

RECORDED 
CONFERENCE  CALL 

RECORDED 
VO'CE  + VIDEO 

Maximum  Number  of  Sites 

One 

Number  of  Ports 
to  the  Mach;ne 

Five 

Two 

Availability  of  Accurate  Record 

No 

Yes 

Possible 

Poss i ble 

Link  to  EDP  Services 

No 

■ 1 

No 

No 

j Emotional  Cor .ents 

H:gh 

Low 

Fai  r 

Fair 

^ Siqnal  Transmission  Capability 

Large 

Fair 

Small 

Large 

| Typing  Requirement 

No 

Yes 

No 

No 

J Visual  Display  Possible 

Yes 

No 

No 

Yes 

No 

YeS 

S.  all 

Smal  1 

Can  Preserve  Ancnynitv 

No 

Yes 

No 

No 

Allows  Aggregation  of  Numerical  Datj 

No 

Yes 

No 

No 

Cost  (Commercial  Pates) 

I2<  per  Mi  1 ■ 
$100  per  0c, 

S 1 5-60  per  Hour 
per  Participant 

j 

j Phone  Charges 

$/33  per  Hour* 

*fiascd  on  the  rate  charged  by  thj  British  Post  Office  fcr  its  Conf rr.vis ion  service.  Conference 
Pit  rurephof  '-  "■'•vice  between  Chicago  4 how  York  is  $6.59  p»  r minute;  anr  service  between  Washington,  DC 
and  New  York  is  $2.59  per  rinum. 


1.  Parameter?;  in  Four  C umnun icat ion  Media 


F i gure 
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activity  structures,  and  decreases  the  reliance  on  simultaneous,  interactive 
exchanges  where  all  participant's  must  physically  be  present  at  terminal  sta- 
tions at  the  same  time. 

Modern  computer  .etworks  have  the  required  properties  for  sCich  an  envi- 
ronment. Conceived  by  its  developers  as  an  experiment  in  resource  sharing, 
tlie  ARPA  network,  in  fact,  provides  a communication  capability  as  a by- 
product of  its  data  processing  power.  The  program  described  here  draws  from 
both  of  these  capabilities. 


■} 


II.  TILE  FORUM  S 'STEM 


A.  BACKGROUND  AND  RESOURCES 

The  Institute  for  the  Future  began  its  investigation  of  teleconferenc- 
ing through  its  interest  in  the  improvement  of  methods  by  which  experts  from 
diverse  fields  add less  problems  in  social  forecasting  and  technology  assess- 
ment. In  March  1971,  the  Institute  proposed  to  ",  he  Advanced  Research  Proj- 
ects Agency: 

"...to  explore  the  applicability  of  on-line  group  conferencing  for 
policy  formulation  via  computer  terminals.  The  key  goal  of  such 
conferencing  will  be  the  effective  use  of  judgmental  data  as  input 
for  forecasting,  planning,  and  deci sicn-raaking , where  the  partici- 
pants are  geographically  separated." 

In  organizing  this  research,  we  were  able  to  draw  from  the  previous  work 
of  Olaf  Heliuer  and  Paul  Baran,  at  the  Institute  for  the  Future,  and  from  the 
efforts  of  Murray  Turoff at  the  Office  of  Emergency  Preparedness;  Thomas 
Sheridan,  in  citizen  participation  research  at  Massachusetts  Institute  of 
Technology;  Norman  Dalkey,  with  computerized  Delphi  at  the  Rand  Corporation; 
and  others.  Our  approach  is  unique,  however,  in  at  least  four  respects. 

1.  The  system  is  designed  to  support  flexible  discussions  that 
may  be  organized  in  real  time,  and  deals  with  computer  con- 
ferencing as  a telecommunications  medium. 

2.  The  project  encompasses  the  development  of  hardware  for  a 
computer-controlled  voice  channel  supplementing  the  typed 
interaction. 

3.  The  project  environment  permits  observation  of  the  confer- 
ences and  the  withering  of  statistics  for  research  purposes. 

4.  For  the  first  time,  an  international  computer  network,  ARPANET 
(see  Figure  2) , is  used  as  the  implementation  environment. 

To  create  an  advanced  form  of  teleconferencing,  we  have  implemented  and 
successfully  tested  a computer  system  called  FORUM,  which  is  now  in  routine 
operation  on  the  computer  network  of  the  Advanced  Research  Projects  Agency. 


Figure  2.  ARPA  Network,  Logical  Map,  January  1 97^ 
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The  bas ' c idea  of  FORUM  is  to  allow  unhampered  interaction  of  partici- 
pants ur  ’er  the  guidance  of  an  organiser  who  defines  a topic  of  discussion, 
assembles  a panel  of  participants  on  that  topic,  and  presents  the  material 
relevant  to  the  subject.  Each  participant  establishes  communication  with 
the  computer  network  via  a portable  terminal  with  a standard  typewriter  key- 
board. EX) RUM  is  able  to  convey  questions  and  answers,  assemble  group  opin- 
ions, protect  anonymous  statements,  and  supply  other  information  to,  and 
within,  the  group  while  the  organizer  monitors  the  proceedings  and  inter- 
venes as  necessary. 

In  order  to  illustrate  the  nature  of  the  interaction  made  possible  by 
FORUM,  it  is  appropriate  to  imagine  a hypothetical  discussion*  among  a group 
of  experts  on  the  subject  of  the  projected  availability  of  mineral  and  energy 
resources  in  the  ptiriod  1980-1990.  The  participants  are  about  twenty  in  num- 
ber. Among  them  are  planners,  economists,  geologists,  and  petroleum  experts. 
Two  are  specialists  in  computerized  data  bases.  In  addition,  there  might  be 
representatives  from  power  and  utility  companies  and  the  president  of  a min- 
ing corporation.  The  organizer  of  the  conference  has  experience  in  dealing 
with  groups  and  is  familiar  with  the  various  techniques  which  can  be  brought 
to  bear  on  the  elicitation  of  forecasts  and  intuitive  judgments  in  areas  of 
high  technology. 

This  hypothetical  conference  differs  from  the  usual  workshop  in  that 
the  participants  are  not  meeting  face-to-face.  Instead,  they  are  geographi- 
cally separated  and  use  a variety  of  communication  media.  Come  are  sitting 
around  a terminal  in  a Washington,  D.C.,  office  building.  A geologist  is 
in  the  computer  room  of  the  Branch  of  Computations  of  the  U.S.  Geological 
Survey  in  Denver.  One  of  the  economists  is  in  his  office  at  Stanford  Uni- 
versity. Another  one  may  be  sitting  in  his  study  at  home  in  New  Jersey  or 
in  London,  for  that  matter.  (These  experts  are  in  telephone  communication 
with  a central  operator  who  can  instantly  advise  them  of  the  status  of  the 
conference,  of  the  progress  of  work  done  in  subcommittees,  or  of  the  rea- 
sons for  any  particular  difficulty  or  delay.)  The  substantive  pare  of  the 
interaction  takes  place  through  entries  typed  on  standard  terminals.  All 
of  the  terminals  are  connected  to  the  network  and  are  controlled  by  a compute 

* Actual  examples  drawn  from  real-life  conferences  are  given  in  flec- 
tion III  and  in  other  parts  of  this  report. 
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This  is  the  capability  of  FORUM. 

Before  describing  our  research  approach,  instrumentation,  and  findings 
in  detail,  it  is  useful  to  describe  the  environment  in  which  the  work  has 
taN'n  place.  The  Institute  for  the  future  is  a small,  nonprofit  organiza- 
tion formed  in  1968.  It  has  special  expertise  in  the  development  of  short- 
to  medium-term  forecasting  techniques.  It  recei\_s  support  from  private 
foundations,  private  corporations,  and  government  agencies  for  the  develop- 
ment of  descriptions  of  future  environments  and  for  the  improvement  of  tech- 
niques through  which  to  arrive  at  such  forecasts.  In  both  types  of  assign- 
ments, the  extraction  of  the  collective  thought  of  groups  of  experts  is  a 
critical  task. 

The  Institute  does  not  have  its  own  computer.  All  of  the  work  on 
ARPANET  is  performed  via  remote  terminals,  most  of  them  of  the  portable  va- 
riety illustrated  in  Figure  3.  These  terminals  are  linked  to  the  network 
by  ordinary  telephone  lines  concentrated  by  a small,  remote  computer  known 
as  a TIP,  or  Terminal  Interface  Processor.  Once  the  connection  to  the  TIP 
has  been  obtained  (by  dialing  a local  telephone  number) , we  proceed  by  re- 
questing access  to  one  of  the  network’s  "host”  computers  where  the  FORUM 
program  is  stored.  At  the  same  time,  other  ARPANET  users  may  be  entering 
the  network  at  other  node  points,  such  as  Washington,  D.C.;  I.ondon,  or  Oslo; 
through  .local  £>hcne  calls.  The  specific  computers  we  have  used  on  the  net- 
work arc  those  of  the  Information  Sciences  Institute  (ISI)  at  the  University 
of  Southern  California  in  Los  Angeles  and  the  Bolt,  Beranek  and  Newman  Com- 
pany (BUN)  in  Massachusetts.  They  arc  of  the  Digital  Equipment  Corporation 
PDP-10  type  and  use  the  TEN EX  time-sharing  executive. 

The  facilities  available  at  the  Institute  (see  Figure  4)  consist  of  two 
blocks  of  three  rooms,  separated  by  a distance  of  about  200  feet  and  consti- 
tuting a miniature  laboratory  for  office  automation.  In  these  offices,  we 
iiave  installed  a variety  of  terminals.  Over  the  first  year  of  the  project, 
mainly  devoted  to  programming,  four  terminals  were  used.  This  number  was 
expanded  to  eleven  over  the  second  year  to  permit  experimentation  with  alter- 
native work  styles  where  staff  members  could,  for  example,  have  terminals  in 
their  homes.  Terminals  were  occasionally  loaned  to  outside  parties  involved 
in  field  tests  conducted  by  o^r  group.  One  terminal  is  a Terminet  printer. 
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and  another  if;  a cathode  ray  tube  display  operating  at  a high  transmission 
rate  (1200  baud  inrut).  This  rate  is  made  possible  by  the  hardware  inter- 
face at.  the  nearest  access  node,  the  HAUA/Ames  TIP  entry  poi*  t to  the  net- 
work. One  work  station  is  used  by  the  conference  controller  end'  contains 
a terminal  with  tape  cassettes  that  permits  the  storii  g of  conference  text 
in  tape  archive  form. 


B.  RbdEAI-’Cli  APPROACH 

The  central  problem  of  implementing  a computer  conferencing  system 
clearly  reduces  to  that  of  identifying,  defining,  and  implementing  a range 
cf  structures  under  which  the  participants  are  able  to  share  information 
and  enter  comments  into  a common  computer -storage  file. 

The  implementation  ot  a system  like  FORUM  raises  unusual  problems  of 
design:  a group  of  experts  or  decision-makers  typically  does  not  have  much 

knowledge  of,  or  interest  in,  computer  technology  per  se.  There  is  no  op- 
portunity to  train  them  in  tne  use  of  a text -oriented  language  before  the 
conference.  And  it  is  not  feasible  to  ask  them  to  interface  with  their 
peer:;  through  information  specialists  because  each  participant  has  a unique 
awareness  of  the  problem  at  hand  and  needs  to  experience  direct  contact  with 
his  data  and  with  other  participants  in  order  to  perform  at  the  "cutting 
edge"  of  his  thinking. 

When  a group  of  conferees  communica tes  via  FORUM,  each  participant  uses 
a terminal  of  the  type  that  can  be  rented  for  $150  a ruonth  or  less.  Once 
the  terminal  has  been  logged  into  the  network,  the  user  is  presented  with  a 
list  of  discussions  which  he  can  attend  (just  as  he  would  if  he  were  to  walk 
into  the  lobby  of  a convention  Center  to  review  the  day*s  program).  Having 
selected  an  activity,  the  conLerec  is  given  a short  background  statement  de- 
scribing the  activity.  He  is  then  free  to  observe  the  ongoing  discussion, 
to  review  past  comments  entered  into  the  conference,  or  to  start  typing  his 
own  remarks  (see  Figure  3) . At  any  point  during  the  discussion,  a conferee 
can  send  a private  message  to  anotnei*  participant  or  make  an  anonyiious  entry. 
All  of  these-  communication  modes  (which  Appendix  1 of  this  report  attempts 
to  char  icterixe  ici  a more  formal  manner)  can  be  entered  without  the  partici- 
pant having  to  learn  a single  command,  thus  avoiding  a major  problem  of  most 
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interactive  systems  in  existence;  namely,  that  system  commands  get  in  the 
way  of  the  person  who  types  and  clutter  the  transcript  with  extraneous  lines 
that  only  have  meaning  for  the  machine. 

An  important  facet  of  FORUM  conferences  lies  in  the  eaie  with  which  the 
participants  have  access  to  services  outside  of  the  discussion  itself:  they 
can,  for  instance,  submit  a prepared  statement  to  the  rest  of  the  group  or 
insert  parts  of  the  discussion  into  a personal  file.  They  can  also  draw  re- 
sponses from  a data-base  system  and  enter  them  into  the  general  discussion. 
Clearly,  the  level  of  interaction  thus  reached  is  one  not  found  in  face-to- 
face  meetings  where  experts  are  cut  off  from  their  files  and  personal  notes. 

The  initial  tasks  in  the  FORUM  project  included  an  analysis  of  the 
available  resources  and  a review  of  the  existing  terminal  technology  in 
terms  of  character  set,  plotting  symbols,  size  of  frame,  speed  of  presenta- 
tion, and  interface  standards.  A decision  involving  the  programming  lan- 
guage to  be  used  had  to  be  made  early;  after  exploration  of  the  languages 
available  on  the  PDP-10  under  the  TENEX  operating  system,  we  reluctantly 
concluded  that  assembly  language  was  the  only  suitable  medium  to  gain  ac- 
cess to  shared  files  and  to  control  terminal  behavior,  both  functions  being 
critical  to  our  goal.  Additional  requirements  were  speed  and  low  central- 
processor  utilization. 

Actual  development  of  the  FORUM  program  proceeded  through  a series  of 
stages  identified  as  '‘releases"  . The  version  currently  running  on  ARPANET 
is  release  5.  Most  of  the  user  experience  reviewed  in  Chapter  III  of  this 
report  was  based  on  this  release.  A description  of  the  various  release  fea- 
tures is  useful  for  the  record. 

Release  1 was  the  first  package  that  formed  a working  system.  It  in- 
cluded the  capability  to  simulate  simple  questionnaires  and  supported  asyn- 
chronous interaction  only,  without  feedback  of  results. 

Release  2 permitted  multiple  rounds  of  a questionnaire.  Display  com- 
mands were  expanded,  and  a structure  for  agenda  items  was  created.  A link 
connection  with  the  conference  chairman  (or  organizer)  was  made  possible. 

Release  3 became  available  in  December  1972.  It  included  a simple  com- 
mand language  for  the  conference  participant;  a detection  for  loss  of  car- 
rier, thus  permitting  the  user  to  terminate  a session  by  simply  hanging  up 
the  telephone  (rather  than  taking  the  time  to  log  out) ; and  a mechanism  for 
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adaptivo  instructions  based  on  skill  ratings.  A primitive  synchronous- 
conversaticn  program  was  introduced  and  was  used  in  real-life  tests.  Tree 
structures  and  file  implementation  were  achieved  in  this  release. 

Release  4 marked  a departure  from  the  initial  approach  that  had  cen- 
tered on  the  implementation  of  the  basic  questionnaire-type  system. 
Discussion-oriented  features  (such  as  automatic  message  identification  by 
author  name,  private-message  mode,  anonymous-message  mode,  and  a host  of 
minor  adaptations)  opened  the  way  for  the  utilization  of  the  program  for 
general  conferencing.  We  began  exploring  alternative  display  modes  for  syn- 
chronous discussions.  The  use  of  the  program  by  ARPANET  participants  became 
significant. 

Release  5 (in  use  on  ARPANET  since  October  1973)  was  the  first  version 
that  could  conveniently  support  heavy  usage  by  real-world  participants.  The 
code  had  been  modified  to  make  the  entire  program  nharable.  Performance 
measurements  showed  its  central -processor  utilization  ratio  to  be  excellent 
(one  minute  of  CPU  time  for  two  hours  of  synchronous  discussion,  per  partic- 
ipant) . Most  command- language  features  became  available  to  the  user  within 
the  discussion  itself,  and  use  of  control  characters  was  practically  elim- 
inated. The  ability  to  retrieve  and  display  past  entries  by  date,  name, 
content,  and  range  was  made  available.  At  that  point,  experience  with  FORUM 
already  included  serious  utilization  by  ARPA  management  and  approximately 
four  months  of  field  testing  by  the  Automatic  Programming  Group  at  USC-ISI. 
network-wide  discussions  were  conducted  routinely  and  included  such  topics 
as  the  design  of  advanced  teleconferencing  systems,  the  transportation/ 
communication  trade-offs,  and  initial  exchanges  of  research  information  with 
the  Communications  Study  Group  in  London. 

Release  6,  which  was  introduced  on  an  experimental  basis  in  August  1974 
and  was  tested  until  termination  of  the  project  in  December  1974,  features 
a single,  integrated  command  language,  a generalization  of  the  concept  of  a 
conference  to  moke  joint  authorship  and  other  management  tasks  possible,  and 
a scheme  for  handlinq  private  messages  in  a personal  user  file  rather  than 
as  part  of  the*  main  discussion. 


-17- 


C.  THE  NETWORK  ENVIRONMENT 

In  attempting  to  relate  FORUM  to  other  types  or  computer  communica- 
tion, it  is  helpful  to  draw  up  a map  of  information-exchange  modes  avail- 
able through  FORUM  (Figure  5) . A certain  mode  of  communication  corresponds 
to  each  element  in  the  matrix:  Mail  is  the  mode  in  which  one  sends  a mes- 

sage to  another  user  with  delay . A real-time  message  to  a group  is  an 
address.  A file  may  be  used  as  a way  of  sending  delayed  messages  in  one- 
self, and  an  example  of  direct  communication  with  one  person  to  real  time 
is  a phone  conversation.  The  functions  of  the  FORUM  system  thus  overlap 
in  some  areas  with  those  of  text  editors  and  mail-distribut  .on  systems  al- 
ready available  on  some  computer  networks. 

The  direction  of  communication  is  shown  across  the  top.  A given  mes- 
sage can  be  sent  by  user  A to  user  B immediately  (column  1) , or  with  delay 
(column  4) . Alternatively,  A and  B may  be  in  real-time  communication  (col- 
umn 3)  , or  in  delayed  communicat ion  (column  6) . User  A may  also  receive  a 
real-time  message  from  B (column  2)  or  a delayed  message  (column  5) . The 
possible  recipients  of  A's  message  are  displayed  vertically;  the  recipient 
can  be  a system,  A himself,  another  individual,  a group,  or  the  public  at 
large . 

Several  limited  communication  modes  were  available  on  the  network 
prior  to  the  introduction  of  FORUM.  We  have  displayed  them  in  Figure  6 A 
in  the  form  of  a single  table. 

The  LINK  mechanism  is  a crude  process  through  which  an  online  user  can 
effectively  attach  another  terminal  to  his  own  and  send  one-line  messages 
across  the  network.  Every  character  typed  is  seen  by  the  other  person. 

There  is  no  opportunity  for  correcting  errors  and  no  more  than  four  users 
can  be  interconnected.  The  LINK  is  useful  for  such  operations  as  brief  mes- 
sages to  the  operator. 

The  SI D (send  message)  system  is  intended  for  use  by  programmers  and 
specially  trained  personnel  in  exchanging  brief  (usually  less  than  ten-line) 
statements  such  as  announcements,  plans  for  meetings,  etc.  The  availability 
of  this  system  has  made  an  imj>uct  on  management  patterns  on  the  network  by 
unburdening  executives  whose  schedules  made  it  difficult  to  respond  to  tele- 
phone calls  or  regular  mail.  SND  is  machine-independent  in  the  sense  that 
a message  can  be  sent  to  a imer  at  any  computer  on  the  network  where  the  re- 
cipient has  an  account. 
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A third  means  for  the  communication  of  information  among  users  of  the 
Fame  machine  is  the  NLS  journal.  This  is  a mechanism  that  accepts  as  input 
a structured  file  produced  by  NLS.  NLS  is  a sophisticated  text  editor  based 
on  the  mathematical  concept  of  plcx , which  is  a generalization  df  a tree 
structure.  The  file  is  treated  as  an  "article"  that  is  disseminated  by  the 
system  to  a list  of  addressees  and  is  retrievable  by  them  through  the  text- 
editcr . 

Both  SND  and  the  NLS  journal  are  totally  asynchronous  (delayed) . The 
LINK  process  is  exclusively  real-time  (simultaneous) . 

One  can  see  in  Figure  6B  how  some  of  the  functions  of  FORUM  overlap 
with  the  processes  described  above,  superseding  some  of  them  and  probably 
enhancing  the  usefulness  of  others.  Also  obv’ ^us  in  Figure  6B  are  the 
clearly  delineated  interfaces  between  FORUM  and  four  categories  of  func- 
tions it  does  not  support:  (1)  computing  capabilities;  (2)  text  editing; 

(3)  information  retrieval;  and  (4)  publication  systems. 

These  four  types  of  capabilities  are  available  on  the  network  in  one 
way  c ~ another,  and  we  have  only  begun  to  tackle  the  problem  of  integrating 
them  with  the  conferencing  functions.  We  have,  however,  taken  care  to  pro- 
vide FORUM  users  with  transparent  interfaces  through  which  they  can  have  ac- 
cess to  such  systems.  They  can,  for  instance,  create  a "lower  fork"  of  the 
operating  system  (giving  them  access  to  all  the  features  of  the  machine) 
without  leaving  the  discussion  activity;  they  can  also  save  entries  from  a 
conference  in  a personal  file  for  later  processing,  or  submit  such  a file 
as  a prepared  statement  into  a conference.  These  features  have  been  avail- 
able in  FORUM  since  release  5. 

The  interface  with  texc  editors  is  provided  in  the  design  for  release  6. 
The  user  can  modify  his  entry  by  simply  hitting  an  ESCAPE  key  on  his  termi- 
nal and  calling  a familiar  text  editor  by  name,  for  instance  TECO.  And  fi- 
nally, we  have  provided  an  interface  with  a voice -communication  system  that 
will  be  described  below. 


D..  VOICE  CHANNEL 


If  a computer-b **.sed  system  is  to  be  truly  useful  for  decision-making 
purposes,  ’ t is  necessary  to  tailor  the  system  to  fit  the  user  needs  and 


I 

I 

| Figure  7*  Remote  Access  to  a Computer  Conference 

Ann  Me C own,  Richard  Miller,  and  Hubert  Lipinski  are  shown  here 
participating  in  a conference  running  on  a remote  computer. 

1 A speakerphone  is  used  to  maintain  a parallel  voice  connection 

■ wi th  other  part ici pants. 

s 
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no  t require  the  user  to  fit  the  constraints  of  the  terminal . Users  are  of- 
ten unaccustomed  to  using  computer  terminals  or  even  to  typing.  To  provide 

comfortable  and  effective  interactive  response  for  people  accustomed  to  sec- 

% 

retaria.1  support  for  converting  their  thoughts  into  clear  language  text,  ac- 
cess to  communications  media  in  addition  to  the  computer  terminal  appears 
necessary.  To  exnect  all  participants  in  an  inquiry  to  operate  within  the 
constraints  of  a single  computer-terminal  system  may  be  unrealistic  unless 
it  is  possible  to  achieve  a markedly  higher,  r.tore  refined  degree  of  compu- 
ter/human interaction  than  that  observed  to  date.  Although  improved  person/ 
termina1  interaction  is  a goal  of  the  present  system  development,  the  Insti- 
tute has  not  achieved  any  major  increase  in  the  ease  of  interaction  for  an 
unskilled  user  using  the  computer  terminal.  Hence,  it  appears  reasonable 
to  conclude  that  other  media — and  especially  two-way  voice  communication — 
will  be  more  than  a useful  injunct;  they  will  be  a necessity.  We  expect 
initial  use  of  the  voice  channel  to  be  for  the  online  training  of  new  users 
of  FORUM  and  for  recovery  instructions.  In  addition,  we  contemplate  using 
it  in  interviews  of  the  participants  during  some  form* 1 experiments. 

The  present  state  of-  the  art  of  voice-conferencing  equipment  is  not 
highly  developed.  Telephone  conference  calls  may  be  placed  commercially 
(workable  with  as  many  as  five  persons)  on  a manual  basis.  Here,  as  . i all 
present  types  of  conferencing  systems,  all  sjjeakers  may  talk  simultaneously 
and  thus  any  speaker  may  interrupt  any  other. 

A more  useful  system  would  allow  "order  wire  control"  and  permit  tighte 
control  and  discipline,  thus  increasing  the  number  of  users  who  may  simultan 
eously  talk  to  one  another.  A search  of:  existing  equipment  found  none  that 
would  fit  the  needs  of  this  project.  Hence,  it  was  necessary  to  draw  up  £pe 
cifications  for  a new  type  of  system. 

The  basic  problem  faced  in  specifying  a voice-conferencing  equipment 
design  is  that  there  j s no  single  best  arrangement.  While  we  do  not  know 
the  ideal  parameter  choices  for  the  design,  we  do  appreciate  the  fact  that 
change;;  in  the  communications  medic  can  have  profound  effects  on  the  nature 
of  the  communications  that  transpire. 

The  precise  manner  in  which  the  ''oice  system  will  eventually  be  used 
in  practice  dictates  the  choice  to  be  made.  Yet  eventual  use  cannot  be 
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speeified  a priori  at  this  early  stage  of  development.  Hardware  constraints 
must  first  be  determined  and  the  human  behavior  response  operating  within 
such  constraints  must  be  tested.  Accordingly,  we  sought  to  specify  a some- 
what "universal"  voice  system  in  which  a wide  variety  of  alternative  voice- 
communication  configurations  could  be  tested.  Zero  cost  and  infinite  capa- 
bility rarely  go  together:  the  more  general  and  nonrestricting  the  system 

specification,  the  more  complex  and  expensive  the  resulting  system  design. 

As  a compromise,  the  Institute  considered  a set  of  five  representative 
benchmark  designs,  or  models,  in  detail.  The  resulting  parameter  sets  were 
presented  as  points  from  which  one  could  estimate  final  design  specifica- 
tions, knowing  what  each  specified  feature  implies  in  hardware  and  develop- 
ment costs.  On  the  basis  of  these  five  models,  one  configuration  (among 
many  possible  hardware  configurations)  was  selected  and  built.  (See  the 
special  Institute  report  by  Paul  Baran,  Voice-Conferencing  Arrangement  for 
an  On -Li  ne  In  terroa  ti  or:  Sys  tom , Ma r ch  1973.) 

The  prototype  system  which  the  Institute  has  tested  is  designed  to 
place  lines  in  one  of  two  states: 

1.  monitor  only;  or 

2.  talk  only  (can  be  used  for  general  broadcast,  in  which  case 
a line  may  be  connected  to  all  conference  paths) . 

A link  is  supplied  to  the  system  for  external  connections  to  a general- 
purpose  computer.  The  design  of  the  system  allows  the  general-purpose  ma- 
chine to  control  the  systt  a.  The  switching  technology  is  analog;  upgrading 
of  the  switch  to  handle  digital  traffic,  if  necessary,  is  possible.  The 
initial  design  does  not  support  Touch-Tone  from  the  telephones  for  system 
control . 

The  system  was  built  by  Mr.  Dean  Romein,  under  the  supervision  of  Dr. 
David  Farber  of  the  University  of  California  at  Irvine,  and  is  depicted  in 
Figure  8. 


III.  EXPERIENCE  WITH  COMPUTER  CONFERENCING 


Since  versions  of  the  FORUM  program  were  made  available  to  ARPA  manage- 
ment in  August  1973  and  to  other  network  users  in  October  1973,  actual  exper- 
ience with  the  system  can  bo  reviewed  and  analyzed.  It  is  important  to 
emphasize  that  in  the  present  report  we  are  not  addressing  the  questions  of 
psychological  and  social  effects  of  teleconferencing,  which  our  group  is 
studying  separately  under  sponsorship  from  other  federal  and  private  organ- 
izations. We  are  specifically  reporting  our  findings  from  three  major  sources 
of  user  information:  the  data  supplied  to  us  by  the  Information  Sciences 

Institute  at  the  University  of  Southern  California,  where  FORUM  has  had  con- 
siderable application;  the  various  collaborative  experiments  we  have  been 
able  to  observe;  and  inhouse  experience  at  the  Institute  for  the  Future. 


ft.  CONFERENCING  AND  DATA-BASE  SYSTEMS 

As  an  illustration  of  actual  use  of  FORUM,  we  might  consider  a confer- 
ence run  in  May  1973  which  linked  together  the  Washington,  D.C.,  Denver,  and 
Menlo  Park  centers  of  the  U.S.  Geological  Survey  in  a series  of  teleconfer- 
ences using  FORUM-4.  (See  Figure  9.) 

The  Denver  participiint  operated  a terminal  linked  to  an  oil  and  gas 
information  system  resident  in  INTONE!" s computer  in  Los  Angeles.  A geol- 
ogist in  Menlo  Park  was  operating  the  DIRAC-2  interactive  retrieval  system 
running  on  the  Stanford  University  IP>M  360/67  computer.  A data  base  of 
Alaska  mineral  resources  was  maintained  under  DIRAC-2.* 

The  following  is  a sample  of  the  interaction  as  it  deveiooed  in  the 
environment  described  (the  names  of  the  participants  have  been  replaced  by 
single  letters) : 


*This  system  is  described  in  a paper  by  Jacques  Vallee  and  Gerald 
Askevold,  "Information  Organization  for  Interactive  Use.*:  Design  Impli- 

cations in  Data-base  Systems,"  Journal  of  ASTS  (July/August  1973). 
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Figure  9*  FORUM  Experiment  on  ARPANET  With 
Information  Retrieval  Coupling  (7  June  1973) 


-27- 


B (Geologist  in  Washington,  D.C.): 

To  all  par t ic i pan ts : Please  ask  your  requests  relative  to  the 

variables  listed  at  the  beginning  of  the  session.  At  this  tine, 
I'd  like  to  ask  you  all  to  submit  the  first  round  of  questions 
(i.e.,  retrieval  criteria). 

A (Geologist  in  Menlo  Park): 

To  D (Geologist  in  Denver):  How  about  a list  of  counties? 

C (Geologist  in  Menlo  Park): 

To  B:  Let's  do  a retrieval  on  pools  in  Colorado  which  have  a 

production  of  greater  than  2, GOO  bbls  in  1969  and  produce  from 
a type  "A"  sand. 

C: 

To  B:  Retrieval  criteria  production  >2,000  producing  rock  type 

"A"  sand. 


A: 

To  D:  Did  you  get  our  request  for  a list  of  counties  included  in 

the  fi le? 


D: 

To  A:  Yes  we  have  the  request  in  the  system. 

Institute  for  the  Future: 

I wonder  if  you  can  fill  this  request.  Can  you  give  me  the  per- 
centage of  unused  oil  and  gas  resources  still  in  the  ground  (com- 
pared to  total  resources)  in  your  sample  data  base. 


B: 

To  Institute:  We  will  give  you  the  total  reserves  for  oil  and 

gas,  and  also  the  total  production.  The  difference  is  your 
answer. 

D: 

To  B:  Here  is  a list  of  county  names:  Baca,  Bent,  Boulder,  Chey- 

enne, Delta,  Elbert,  Fremont,  Garfield,  Jackson,  Jefferson,  and 
Ki owa . 

B: 

To  all:  Please  try  and  stick  to  the  variables  listed  in  the  be- 

ginning of  the  session. 

To  D:  For  Institute  use  variable  L1A  and  L1C  for  reserves. 

D: 

• Nine  records  were  found  which  had  annual  production  of  crude  in 
1969  greater  than  2,000  bbls. 
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A: 

O.K.  0:  How  about  a list  of  all  the  oil  fields  in  Cheyenne 

County  and  their  annual  production  for  19/0? 

B: 

To  A:  Remember  that  Roger  has  to  type  in  the  output  from  the 

search . 

To  all:  Remember,  we  can  tabulate  numeric  variables. 


A: 

We  are  now  asking  questions  of  the  Alaska  file  asked  by  interested 
vi  s i tors  . 

C: 

To  A:  Can  you  give  us  an  idea  of  what  is  going  on? 

B: 

To  A:  There  is  one  pool  in  the  county.  The  pool  name  is  Missis- 

sippian.  The  production  for  1970  was  22,180  bbls.  The  associated 
gas  production  was  800  MCF. 


A: 

We  are  showing  Ed  and  Pauline  how  the  file  works.  So  far  they 
have  asked  things  like:  How  many  properties  contain  gold  and 

s i 1 ver? 

Chai rman : 

To  A:  What  is  the  nature  of  the  data  in  the  Alaska  file? 

A: 

To  D:  Thanks  much. 

C: 

It  is  obvious  to  me  that  so  far  this  morning  we  have  been  able  to 
demonstrate  a capability  that  the  Survey  has  an  immediate  need 
for.  We  have  also  answered  at  least  5 letters  that  normally  cross 
the  5th  floor. 

A: 

To  C:  There  are  no  entries  with  W but  we  found  two  that  contain 

silver. 


A: 

To  C:  We  are  following  up  on  your  request. 
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• D : 

To  Institute:  There  are  two  records  in  the  file  with  the  data  for 

• crude  originally  in  place.  These  two  records  each  show  9,500,000 
bbls  originally  in  place  and  the  cumulative  production  through  1970 

• was  2,293,336  bbls  for  one  and  184,831  bbls  for  the  other. 

• A: 

To  C:  Both  are  occurrences  for  which  we  have  no  reserve  data. 

• Neither  has  significant  economic  potential. 


The  participants  held  a conference  call  by  telephone  after  the  online 
sessions.  The  ability  (found  in  FORUM)  to  link  together  the  resources  of 
several  information  centers,  possibly  operating  different  computer  networks , 
was  seen  by  all  participants  as  a concept  of  great  interest. 


B.  FORUM  IN  RESEARCH 

It  is  often  the  case  that  memberr  of  a scientific  ree  arch  team  work 
away  from  one  another  and  rely  on  a communication  medium  to  remain  informed. 
Even  when  no  geographical  separation  is  involved,  however,  a tool  such  as 
teleconferencing  can  provide  a convenient  way  for  scientists  to  pool  their 
ideas  and  support  the  research  process. 

Beginning  in  July  1973,  FORUM-4  and  eventually  FORUM-5  was  used  as  one 
medium  of  communication  for  the  Automatic  Programming  Group  at  the  Informa- 
tion Sciences  Institute  (ISI)  of  the  University  of  Southern  California.  The 
research  being  done  during  this  period  involved  advanced  work  in  the  area 
of  automatic  computer  programming.  The  style  of  FORUM  usage  which  developed 
provided  a kind  of  collective  note  pad  for  the  research  team.  In  this  ap- 
plication, then,  the  role  of  FORUM  was  quite  specific  and  somewhat  limited. 
At  the  end  of  a two-month  period,  two  Institute  researchers  visited  ISI  to 
interview  all  the  participants  and  obtain  their  reactions  to  the  medium. 

The  following  is  a summary  of  the  findings. 

There  were  nine  active  participants  in  the  research  group  using  FORUM, 
and  they  were  divided  into  small  topiic-orien ted  groups.  Each  of  these  small 
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groups  had  individual  concentrations,  but  there  was  also  a strong  need  to 
keep  in  touch  with  the  activities  of  the  other  small  groups. 

FORUM  (then  still  in  the  early  testing  stages)  was  introduced  as  a pos- 
sible communications  aid  by  the  project  leader.  A demonstration  was  given 
to  the  research  staff  at  IS7:  during  early  June.  This  demonstration  involved 
a synchronous  conference  of  twelve  persons,  with  no  specific  topic  area  to 
be  discussed. 

The  use  of  FORUM  as  a tool  in  the  actual  research  began  without  any  de- 
tailed strategy  about  the  role  it  would  have  in  the  group.  The  project 
leader  simply  began  leaving  messages  in  the  FORUM  program.  Gradually,  an 
agreement  was  made  for  all  members  of  the  staff  to  check  FORUM  each  day  for 
new  information  and  add  their  own  comments.  From  this  point,  they  quickly 
developed  the  habit  o7  entering  summaries  of  their  face-to-face  meetings. 

Over  the  period  of  time  described  here,  FORUM  became  an  important  part 
of  the  group  process.  The  style  of  usage  which  evolved  made  interaction  be- 
tween groups  efficient  and  provided  transcripts  as  an  important  written  rec- 
ord of  the  collective  thought  process. 

During  the  time  when  FORUM  was  being  used  by  the  Automatic  Programming 
Group,  other  media  ol  communication  were  also  being  used.  The  media  that 
can  be  identified  as  important  are: 

• face-to-face  meetings  of  small  topic  groups  (usually  held 
daily)  and  of  the  entire  research  group; 

• FORUM  in  an  off-line  mode,  using  hard-copy  transcripts  of 
the  information  entered  into  the  system; 

• informal  meetings  among  staff  members  (e.g. , those  with  ad- 
joining offices) ; 

• other  computer-based  media,  such  as  messages  sent  through 
network  nail,  copies  of  documents  stored  in  files,  etc.; 
and 

• FORUM  in  an  online  environment  using  cathode  ray  tube  ter- 
minals (used  mostly  for  skimming  the  text  of  other  confer- 
ences and  inputting  reactions  to  hard-copy  transcripts) . 

The  FORUM  discussions  were  used  primarily  to  store  and  distribute  work- 
ing notes.  These  notes  consisted  of  summarized  thoughts,  notes  of  meetings, 
synopses,  ana  the  additions,  corrections,  and  consents  which  referred  to  the 
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summaries.  The  notes  were  not  of  a particularly  polished  nature,  but  were 
generally  the  "filtered"  results  of  longer,  more  intense  face-to-face  meet- 
ings. Occasionally,  a new  or  rather  unrefined  idea  was  put  into  FORUM  dis- 
cussions in  an  attempt  to  receive  feedback  and  reactions.  This  'feedback, 
however,  was  rarely  entered  into  a FORUM  discussion. 

The  responses  that  were  put  into  FORUM  were  generally  triggered  by  hard- 
copy transcripts  of  discussions  which  were  created  as  special  computer  files 
(in  TEtJEX)  , edited,  run  off  in  multiple  copies,  and  distributed  daily.  This 
organization  and  distribution  of  hard-copy  transcripts  was  done  by  a very 
competent  editor -secretary,  and  wa?>  not  done  within  FORUM.  It  is  our  plan, 
however,  that  FORUM  will  gradually  ^dopt  much  more  of  this  editorial  func- 
tion in  the  future. 

In  keeping  these  running  summaries  and  synopses,  the  records  were  de- 
tailed enough  to:  (1)  allow  communication  between  groups;  (2)  allow  a new- 

comer to  the  group  to  read  a history  and  catch  up  on  the  research  status  of 
the  entire  group;  and  (i)  allow  the  various  groups  to  create  reports,  papers, 
and  more  polished  summaries  of  the  work  conducted  during  the  period  in  which 
FORUM  was  used . 

The  research  group  it  ISI  was  formed  just  before  the  use  of  FORUM  was 
begun.  Six  of  the  nine  active  participants  were  graduate  students,  and  half 
of  those  graduate  students  were  there  for  only  one  summer.  Only  basic  user- 
profile  data  are  available,  though,  and  there  was  no  attempt  to  do  any  formal 
group  analyses  as  either  pre-  or  post- tests.  Thus,  we  can  only  relay  infor- 
mation on  the  subjective  assessment  of  the  group  members  as  they  attempted 
to  sort  out  the  effects  which  FORUM  had  on  their  research  team. 

The  general  reactions  to  computer  conferencing,  limited  to  structured 
asynchronous  applications,  were  positive.  Most  participants  felt  that  this 
was  an  appropriate  limitation  and  that  computer  conferencing  would,  in  fact, 
be  most  beneficial  in  highly  structured  situations.  (It  should  be  noted 
that  synchronous  conferencing  was  not  attempted  by  the  whole  group,  or  any 
of  tiie  small  groups,  after  the  initial  demonstration,  in  which  there  was 
general  disappointment.) 

There  was  a generally  negative  reaction  to  the  necessary  reliance  on 
typing  ability.  This  was  a problem  for  five  of  the  nine  members  of  the  group 
and  may  have  affected  the  usage  of  FORUM  which,  developed. 
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The  comments  regarding  specific  characteristics  of  FORUM  seemed  partic- 
ularly thoughtful  and  sometimes  imaginative.  Since  the  participants  were 
all  highly  skilled  computer  users,  it  is  perhaps  not  surprising  that  much  of 
their  attention  was  focused  at  this  level.  In  general,  the  group  was  im- 
pressed with  the  simplicity  and  general  friendliness  of  FORUM.  However, 
this  basically  positive  reaction  was  tempered  by  numerous  suggestions  for 
modifications  of  the  structure  of  the  system.  Apparently  the  version  of 
FORUM  being  used  at  that  time  was  alluring  enough  to  whet  their  appetites 
for  computer  conferencing,  but  xaft  them  frustrated  at  certain  points. 

The  most  obvious  weak  point,  felt  unanimously,  was  the  pressing  need 
for  at  least  basic  abilities  in  text  editing  and  review  of  conference  pro- 
ceedings. Suggestions  for  improvement  included  adding  the  ability  to  input 
directly  from  a text  editor  outside  of  FORUM,  allowing  persons  to  rewrite 
and/or  add  postscripts  to  their  own  earlier  comments,  allowing  comments  to 
be  inserted  into  previous  text,  abilities  to  search  the  text  according  to 
various  criteria,  among  others.  Most  of  these  suggestions  have  now  been 
incorporated  into  release  6 . 

One  of  the  more  provocative  suggestions  dealt  with  the  ability  to  al- 
ter existing  text  (specifically,  to  change  one's  earlier  comments) . in  its 
present  form,  FORUM  has  an  implicit  reverence  for  comments  entered  by  an 
individual.  These  entries  are  indiscriminately  frozen  in  the  form  in  which 
they  are  entered.  Certainly  this  practice  has  a real  value  if  one  wants  to 
review  the  chronological  development  of  a conference.  However,  in  other 
cases,  this  might  place  unnecessary  pressures  on  each  user.  (What  you  say 
had  better  be  good,  because  it's  going  to  stay  there!)  The  ISI  people  sug- 
gest that  some  flexibility  should  be  considered,  and  indeed  FORUM  now  al- 
lows increased  freedom  in  this  regard. 

Most  of  tiie  group  members  had  adjoining  offices  and  they  saw  each  other 
daily — usually  in  face-to-face  meetings — to  discuss  the  research.  The  basic 
relationship  between  FORUM  and  these  face-to-face  meetings  is  discussed  in 
the  following  comments: 

"The  main  issues  in  the  group  were  not  really  discussed  in  F jRUM. 

FORUM  was  sort  of  the  key  that  started  the  interaction.  (It  showed 
where  ideas  were  coming  together  or  diverging.)  It  kept  people  out 
of  everybody  else's  hair.  We  vrere  able  to  work  independently.  I 
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think  we  got  about  three  times  as  much  work  done  because  of  this. 

But  it's  so  hard  to  know  what  the  effect  of  FORUM  was  because  we 
were  interacting  in  so  many  different  ways  at  once." 

"In  general,  when  we  talked,  we  talked  face-to-face."  . 

"I  have  this  feeling  that  it  has  cut  the  face-to-face  communication 
(at  least  for  me) . And  the  communication  is  still  quite  adequate." 

"Having  this  feature  [FORUM]  really  was  a nice  addition  to  the  group, 
and  I think  it  kept  them  moving  pretty  well." 

Since  FORUM  was  rarely  used  as  an  interactive  medium  in  this  particu- 
lar ^ase,  its  effects  on  group  dynamics  were  necessarily  indirect.  Distri- 
bution of  the  hard-copy  transcripts  encouraged  this  ncninteractive  style. 
FORUM  still  had  an  effect,  but  it  came  in  such  areas  as  the  following: 

"I  canJt  think  of  any  effects  on  the  group  which  actually  cane  from 
FORUM  usage,  except  that  we  have  a good  transcript.  It  makes  writ- 
ing the  report  much  easier." 

"One  of  the  uses  for  the  thing  [FCRUM]  is  in  the  ability  to  catch  up 
with  the  progress  of  the  group  for  newcomers." 

"FORUM  structured  things  much  more  explicitly . " 

"You  don't  get  tnc  personality  conflicts  in  FORUM  that  you  do  in 
face-to-face  meetings." 

"I  didn't  see  too  many  individual  things  going  into  FORUM  which 
hadn't  been  tested  out  in  face-to-face  meetings.  A lot  of  what  went 
into  FORUM  was  well  filtered  by  individual  group  meetings.  Occasion- 
ally somebody  would  put  in  a response,  but  the  things  which  were  put 
in  were  usually  hashed  out  in  group  meetings." 

The  style  of  FOF.JM  usage  will  always  affect  the  kind  of  group  process 
which  develops.  In  this  case,  the  note-pad  style  seemed  to  limit  the  direct 
effect  of  FORUM  on  the  group  process.  Since  kittle  direct  communication  was 
done  via  FORUM,  the  effects  were  revealed  more  in  the  area  of  group  perform- 
ance than  group  dynamics.  The  group  generally  felt  that  FORUM  had  increased 
their  productivity,  though  they  did  not  perceive  any  strong  impact  on  group 
interaction.  The  one  exception  to  this  observation  involved  effective  com- 
munication between  groups,  which  all  felt  was  enhanced  by  FORUM. 
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C.  IN HOUSE  APPLICATIONS 

Figure  10  shows  the  development  of  FORUM  usage  at  the  Institute  for  tlie 
Future  from  August  1973  to  February  1974.  The  purpose  of  this  experiment 
(in  which,  nearly  a thousand  entries  were  recorded)  was  to  use  the  Institute 
itself  as  an  initial  test  of  the  effectiveness  of  teleconferencing  in  long- 
term group  conmunication.  The  use  of  FORUM  in  this  connection  /as  both  syn- 
chronous and  asynchronous,  and  access  was  from  both  home  and  office  termine  . 

A special  study  of  an  inhouse  FORUM  staff-meeting  conference  was  con- 
ducted by  Arthur  Hastings,  a consultant  to  the  Institute,  who  analyzed  the 
period  from  27  September  1973  to  4 January  1974.  An  inspection  of  the  tran- 
script suggests  that  the  conference  can  be  divia^d  into  several  categories 
relating  to  the  project.  These  are  indicated  in  Figure  11,  along  with  the 
percentage  of  entries  in  each  category. 

Different  categories  might  cut  across  those  which  are  listed,  a fact 
which  should  be  remembered  in  any  appraisal  of  the  use  of  FORUM.  For  exam- 
ple, the  categories  do  not  fully  reflect  the  social  dimension  cf  the  ex- 
changes, such  as  friendly  comments  and  personal  exchanges  which  were  often 
parts  of  topic  discussions.  _Uor  do  they  specify  the  actual  topics  of  dis- 
cussion. However,  in  examining  these  particular  categories,  we  can  see  how 
the  stuff  used  the  medium  as  part  of  its  project  responsibilities. 

Rer  irts  from  Staff  Away  from  the  Institute  for  the  Future 

Two  staff  members  did  extensive  traveling  during  the  period  of  this 
staff  meeting  conference.  They  took  terminals  with  them  on  their  trips  and 
submitted  reports  on  their  activities  from  those  locations  into  the  FORUM 
conference.  The  highest  proportion  of  entries  in  any  category  was  from  such 
reports.  The  value  of  this  reporting,  according  to  comments  from  other 
staff  members,  was  its  immediate  availability  for  the  other  staff  members 
to  read  and  to  offer  responses. 

This  use  has  the  rurther  advantage  of  enabling  the  participant  to  form- 
ulate a .lev;  of  his  activities  and  put  them  into  hard-copy  form  which  is  al- 
ways accessible  for  his  own  use.  Further,  one  researcher  commented  that  he 
and  another  staff  member  had  attended  the  suiae  meeting  and  it  was  only  when 
earn  reported  on  the  meeting  via  FORUM  that  they  realized  each  hud  different 
recollections  of  some  of  the  events  of  the  meeting. 


Conference  ff  1:  Experi men tal,  Des i gr. 

Conference  #2:  Staff  Meeting 


Figure  10.  Growth  Curve  for  Two  Institute  Conferences 
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Reports  from  staff  members  while 
the  Institute 

away  from 

38.?2 

General  comments 

8.32 

Conference  reports 

5.0 

Meetings  with  researchers 

20.0 

Funding  agencies,  public 
relations 

5.0 

Operations  of  the  project 

32.2 

Log  of  project  activities,  records 

1*.5 

Meetings  with  other  researchers 
(at  the  Institute) 

6.1 

Personal 

8.9 

100.02 


Figure  11.  Categories  of  Entries  in  a FORUM  Staff  Conference 


-37- 


One  qualification  can  be  made  regarding  this  form  of  reporting:  At  the 
time  the  entry  is  made,  there  may  not  yet  be  a perspective  from  which  to 
judge  its  usefulness,  so  the  transcript  may  be  filled  with  entries  which  are 
of  little  use  to  others.  To  avoid  this,  it  would  seem  possible  to  hold  pre- 
travel discussions  among  the  staff  to  prepare  for  what  might  be  reported 
and  to  engage  in  dialogue  and  responses  to  reports  from  traveling  staff  mem- 
bers as  they  are  made  in  the  conference.  This  feedback  would  make  the  re- 
ports more  useful  to  the  staff  me'i^rs  in  the  office  and  would  help  the 
traveler  to  know  better  what  areaj  of  his  reports  are  receiving  attention. 

Operations  and  Management  of  the  Project 

Operations  and  management  of  the  project  were  among  the  major  purposes 
for  which  FORUM  was  used.  Of  course,  since  the  members  of  the  project  staff 
were  all  in  the  same  suite  of  offices,  much  of  the  coordination  of  the  proj- 
ect occurred  through  face-to-face  meetings.  For  example,  researchers  in  the 
sane  office  would  naturally  share  information  directly.  To  use  FORUM  in 
such  a situation  would  have  been  artificial.  Also,  there  was  no  enforced 
use  of  FORUM  during  this  trial  period,  partly  because  the  network  was 
unreliable. 

Hven  with  these  basic  circumstances,  the  system  was  used  for  many  as- 
pects of  project  coordination,  such  as  setting  up  an  agenda  for  a face-to- 
face  staff  meeting,  verifyii  j locations  of  terminals,  and  discussing  plans 
for  a teleconferencing  workshop  which  was  held  at  the  Institute.  It  was 
used  for  giving  instructions,  for  passing  information  to  one  person  or  the 
group,  and  for  stating  rules,  plans,  and  intentions  in  writing.  When  one 
or  more  of  the  staff  members  was  traveling,  FORUM  was  sometimes  used  to 
meet  project-management  needs. 

However,  primarily  because  of  the  proximity  of  the  staff  members'  of- 
fices, FORUM  was  generally  used  for  the  less  urgent  matters  which  required 
less  interaction.  Frequently,  FORUM  was  used  as  a log  of  what  had  happened 
on  the  project,  serving  as  a common  file  for  the  staff  members.  Typically, 
staff  members  would  rer>ort  a meeting  with  a job  applicant,  describe  an  In- 
stitute staff  meeting,  report  on  a meeting  with  a *;ponsor,  discuss  trial 
sessions  using  graphics  facilitation,  and  other  such  matters.  Seine  of  these 
log  reports  were  about  activities  of  the  project  per  se , like  a historical 


record,  while  others  were  reports  of  one  person's  activities  which  were  of 
relevance  to  the  rest  of  the  project  staff.  (Some  of  tiiese  reports  overlap 
with  the  "operations"  category,  of  course.) 

It  is  not  clear  from  discussion  with  the  staff  members  how  mucti  these 
entries  were  used,  but  they  could  serve  as  an  open  file  which  could  be  re- 
viewed for  any  one  topic,  and  participants  reported  doing  this  on  topics  of 
interest  to  them.  The  log  would  be  particularly  useful  as  a common' -memory 
file,  where  one  participant  could  gain  access  to  the  activities  of  another 
staff  member  by  reviewing  the  conference  entries.  Over  a period  of  time, 
the  transcript  would  become  an  invaluable  document  which  could  be  reviewed 
periodically  during  the  project  on  a semiregular  basis. 

There  were  three  principal  kinds  of  entries  relating  to  the  FORUM  pro- 
gram itself.  The  first  was  a discussion  of  potential  design  features  of 
the  program,  e.g.,  the  discussion  of  monitor  and  overview  capabilities . 

The  second  category  consisted  of  announcements  of  implementation,  changes, 
and  features  of  the  program.  A third  category  had  to  do  with  problems, 
bugs,  and  questions.  The  transcript  also  contains  comments  on  such  topics 
as  passwords,  the  network,  terminals,  and  the  warmth  of  the  FORUM  program 
for  new  users. 

Often  other  researchers  in  the  field  of  computer  conferencing  would 
visit  the  Institute  offices,  and  these  visits  were  usually  reported  in  the 
conference.  Entries  thus  made  would  again  serve  as  a memory  record  for  the 
croup's  activities  and  provide  references  to  research  activity  relevant  to 
FORUM.  (These  could  be  included  under  "log  of  activities",  but  they  are 
enumerated  separately  to  show  t;  • comparison  between  research  meetings  which 
occurred  on  trips  and  those  which  occurred  at  the  Institute  offices.) 
Thirty-six  of  the  travel  entries  reported  on  research  and  researchers  in 
comparison  with  eleven  at  home . As  reflected  by  these  entr’as,  travel  was 
ci  rich  arid  compelling  source  for  these  matters. 

In  the  "personal"  category  falls  a variety  cf  greeting  and  personal  com- 
..  c;u.:;.  There  Were  probably  many  more  than  appeared  in  the  transcript,  be- 
cause the  .<•  kinds  of  moss  i jOa  were  usual  Ly  sent  in  the-  private  mode  and  thus 
..re  i.o L in  the  conference  record.  They  are  probably  essential  to  FORUM  con- 
1 < re no i n j # however,  because  they  are  ways  of  making  a written  mode  more 
re . l sona  1 . 
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Styles  of  Discussion 

In  this  transcript,  individual  staff  members  tended  to  be  consistent  in 
their  style  and  choice  of  subjects,  although  there  may  have  been  some  adap- 
tation to  the  knowledge  that  what  they  were  writing  would  be  read  by  every- 
one (and  perhaps  by  those  not  even  in  the  conference) . The  most  obvious  mark 
of  individuality  was  in  the  choice  of  subjects.  As  discussed  earlier,  earn 
member  of  the  project  had  particular  responsibilities  on  the  proiect,  and 
each  person's  entries  tended  to  emphasize  his  area  of  responsibility. 

Length  of  entries  is  another  characteristic  in  which  individuality  is 
shown.  All  the  staff  members  broke  up  long  entries  into  shorter  ones,  usu- 
ally according  to  paragraphs  or  topics.  This  was  also  a function  of  the  sub- 
ject itself,  but  the  individual's  preference  for  entry  length  did  seem  to  be 
stable. 

Most  of  these  entries  were  made  in  the  asynchronous  mode:  they  were  en- 

tered into  tlie  transcript  when  the  participant  was  the  only  person  present 
(or  when  less  than  the  whole  group  was  present)  and  were  read  at  a laeer 
time  by  other  participants  as  they  entered  the  program . Although  there  were 
several  synchronous  discussions  (with  two  or  more  participants  present  at 
the  same  time) , the  staff  meeting  conference  was  primarily  asynchronous  and 
served  more  as  a discussion  and  log  of  individual  activities. 


Decision-Making 

The  following  decision-making  issues  were  discussed  in  FORUM  during 
this  period: 

• monitor  and  overview  capabilities  of  FORUM; 

• exchange  of  pajjers  on  Communications  Studies  Croup; 

• mailing  list  and  bibliography;  and 

• facilitator  for  teleconferencing  workshop. 

These  were  relatively  minor  decision  matters  and  very  few  in  number, 
considering  the  range  of  decisions  that  the  project  faced  through  the  time 
period  of  the  staff  meeting  conference.  For  example,  action  decisions  by 
the  project  staff  included  the  hiring  of  a new  staff  person  and  the  design 
of  release  6.  nothing  regarding  the  former  was  mentioned  in  the  transcript. 
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i’ntries  on  release  6 included  announcements  of  face-to-face  meetings  to  dis- 
cuss the  language  structure  and  planned  features.  Any  discussion  that  went 
into  the  choices  and  design  occurred  outside  of  the  transcript. 

% 

Conclusions  on  Institute  Usage 

For  a number  of  reasons  we  have  found  it  convenient  to  use  FORUM  in  our 
own  work.  A major  purpose  of  the  Institute  is  to  organize,  structure,  and 
imprc  /e  the  collective  work  of  groups  of  experts.  The  probability- estimate 
elicitation  and  forecasting  features  of  FORUM  are  being  used  in  several  proj- 
ects dealing  with  future  trends  in  communications  regulations,  with  the  chem- 
ical industry,  and  with  the  telephone  industry.  In  the  study  of  communica- 
tion trends,  the  panelists  were  called  upon  to  make  projections  of  a number 
of  trends,  and  all  probability  estimates  were  processed  using  FORUM  subrou- 
tines. In  this  application,  the  probability  density  assigned  by  each  re- 
spondent. was  corrected  according  to  his  estimating  ability  and  weighted  ac- 
cording to  his  degree  of  expertise  in  order  to  arrive  at  a group  estimate. 

Another  application  of  the  FORUM  system  in  open-discussion  mode  was  the 
maintenance  of  contact  with  staff  members  during  periods  of  travel  away  from 
the  Institute.  On^  researcher,  v/ho  formally  joined  the  staff  in  July  1973, 
actually  participated  in  a number  of  meetings  and  made  valuable  contributions 
to  the  project  during  May  and  June  1973,  while  he  was  still  residing  in  an- 
other part  of  the  country.  On  another  occasion,  one  staff  member  was  visit- 
ing a Massachusetts  computer  company  and  needed  specific  data.  He  was  able 
to  obtain  it  by  joining  an  ongoing  FORUM  meeting  involving  several  research- 
ers in  California  and  New  Jersey.  This  led  to  an  immediate  exchange  of  in- 
formation that  might  otherwise  have  been  lost. 

Although  many  of  these  observations  are  anecdotal,  one  point  of  special 
interest  in  such  staf f -meeting  situations  is  the  fact  that  FORUM  makes  it 
possible  for  management  decisions  regarding  current  and  future  plans,  .ched- 
ulos,  and  assignments  to  te  kept  for  future  reference  .in  the  context  of  the 
di ncuniiion  in  which  these  decisions  were  made.  The  ability  to  refer  to  such 
a transcript  later  is  invaluable. 

The  inhou.se  use  of  FORiJM  a 1 so  revealed  the  change  in  life  style  that 
ntich  a medium  makes  possible.  Better  utilisation  of  personnel  and  computer 
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time  and  the*  ability  to  extend  the  range  of  environments  in  which  on  indi- 
vidual staff  member  may  work  without  losing  contact  with  the  team  are  some 
of  the  advantages  that  jioint  to  the  feasibility  of  applying  future  versions 
of  FORUM  in  the  general  office  environment.  • 

More  significant  than  synchronous  usage  among  the  staff  was  the  experi- 
ence the  Institute  gained  in  conferencing  with  other  groups.  A number  of 
synchronous  discussions  was  held  with  other  scientists,  both  to  introduce 
them  to  the  concept  of  teleconferencing  and  to  discuss  substantive  research 
issues  of  common  interest.  An  example  of  such  a conference  is  given  below. 
The  participants  involved  here  were  Jacques  Vallee  and  Richard  Miller  of  the 
Institute  staff  and  a geologist  referred  to  as  "A"  who  was  in  the  office  of 
another  geologist  rererred  to  as  "R" . The  discussion  was  as  follows: 


• Ml  LLER  * (Chrnm)  : 

I thought  that  before  we  discussed  the  applications  of  FORUM,  we 

• might  talk  briefly  about  interpersonal  communication  via  a tele- 
conferencing system. 

• 

VALLEE  : 

• Ha*/  do  you  mean  that,  Rich?  As  a way  of  linking  members  of  a pro- 
fessional community? 

MILLER  (Chrnn)  : 

• Yes . 


I'd  liFe  to  interject  a reaction  by  Mr.  R to  the  proposed  agenda. 

He  feels  that  the  most  important  question  in  something  like  his 
program  is  the  necessity  to  draw  in  many  people  who  have  no  ex- 
perience v/i  th  computers  or  "gadgets"--that  the  process  has  to  be 
at  a personal  level,  rather  than  at  a mechanical  level.  Therefore, 
telephone  nay  be  a necessary  way  to  break  the  ice  and  leave  new 
users  with  the  idea  of  an  impersonal  method. 

VALLEE  : 

After  the  experiment  we  did  last  week  (in  connection  with  data 
bases)  do  you  feel  the.  parallel  voice  channel  helps  in  solving 
this  ''breaking  of  the  ice"  problem? 
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A : 

Let  me  correct  my  last  sentence  by  saying  I meant  NOT  to  leave 
new  people  with  an  impersonal  feeling  until  they  get  into  it. 

A : 

1 don't  think  there  is  a parallel,  because  I was  quite  used  to 
the  system. 

A : 

Mr.  R corrected  me  in  that  the  telephone  is  impersonal  to  a degree 
also... it's  more  a matter  of  moving  from  levels  of  "familiarity". 

MILLER  (Chrmn)  : 

But  I was  not  used  to  the  GRASP  system.  And  I thought  that  the 
use  of  voice  was  a help  for  the  first  ten  minutes  or  so,  since  the 
use  of  the  GRASP  system  became  pretty  clear  to  me  after  that  amount 
of  time.  After  the  first  ten  minutes,  the  voice  channel  was  not 
necessary. 

VALLEE  : 

Yes,  you  were  used  to  the  system,  but  I wasn't  used  to  YOURS  in 
that  case,  and  the  explanations  given  over  the  phone  DID  help  in 
straightening  out  some  retrieval  problems. 

MILLER  (Chrmn)  : 

If  this  is  the  case,  what  is  the  solution?  A meeting  of  the  par- 
ticipants in  face-to-face  conversation  before  using  either  the 
telephone  or  teleconferencing  for  group  discussion? 

VALLEE  : 

....Or  a picturephone-type  device  that  enables  you  to  establish 
visual  contact  with  the  other  person? 

A : 

Mr.  R feels  that  initially  visual  contact  would  be  ideal,  but  af- 
ter brief  exposure  may  be  no  more  necessary  than  a phone  conversa- 
tion in  this  same  context.  Face-to-face  could  be  the  most  desir- 
able, but  may  not  be  practical. 

VALLEE  : 

Based  on  our  experience  so  far,  we  feel  that  FORUM  will  obviously 
not  replace  face-to-face  conferencing,  but  rather  will  enhance  its 
efficiency. . . 

VALLEE  : 

By  this  I mean  that  participants  who  have  already  put  their  main 
ideas  on  record  via  a FORUM- 1 ike  system  can  skip  all  the  prelimi- 
naries when  the  time  of  the  face-to-face  meeting  comes,  and  they 
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can  get  to  the  really  substantive  issues  right  away.  In  ordinary 
conferences,  as  we  know  well,  it  takes  two  or  three  days  of  dis- 
cussions to  reach  that  point. 

MILLER  (Chrmn)  : 

Also,  this  implies  the  practicality  of  the  system  for  pre-formed 
work  groups.  For  example,  if  the  project  staff  has  met  at  some 
time  to  delineate  the  general  problem  or  task,  they  have  a feel- 
ing for  the  individual  personality  of  their  partners  and  can 
forego  the  telephone  conversation  or  face-to-face  meeting  that 
precedes  the  initial  session  of  a new  work  group. 

MILLER  (Chrmn)  : 

This  is  why  I think  that  the  FORUM  system  has  applications  for 
projects  with  a staff  that  knows  each  other  and  which  communicates 
by  other  means  besides  FORUM. 

A : 

If  you  are  wondering  what  the  delays  are  due  to  here,  we  are  dis- 
cussing various  problems  and  ideas  that  are  prompted  by  the  "FORUM 
discussion. 

MILLER  (Chrmn)  : 

We  were  just  discussing  the  fact  that  we  were  probably  losing  the 
most  interesting  information  that  you  were  producing,  in  that  the 
discussion  that  you  are  having  is  not  being  recorded  or  trans- 
mitted to  us. 

A : 

Mr.  R is  largely  in  agreement  with  the  above  points.  He  would  fur 
ther  suggest  that  this  seems  to  be  an  argument  for  internal  use  vs 
some  type  of  public  or  outside  use.  Comments? 

A : 

That  is  probably  true. . .unfortunatel y,  you  will  probably  have  to 
rely  on  my  demonstrated  faulty  memory  to  relate  some  of  what 
transp i red . 

MILLER  (Chrmn)  : 

Public  use  implies  a lot  of  problems  that  we  have  no  means  to  eval 
uate,  at  least  right  now.  The  internal  use  also  fits  our  descrip- 
tion and  impression  of  F03UM  as  a complementary  medium  of  communi- 
cation, rather  than  the  sole  means. 

VALLEE  : 

I think  the  STRUCTURE  of  a given  discussion  determines  where  it  is 
placed  in  the  pectrum  from  private  (internal)  to  public. 
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VALLEE  : 

Of  course,  when  a tool  like  FORUM  is  used  as  a front-end  to  data- 
base software,  the  picture  changes  completely. 

% 

A : 

Jacques,  please  expand  on  this  last  point  (or  elucidate). 

VALLEE  : 

For  internal  use  you  would  expect  to  have  well-defined  agenda  and 
applications  like  remote  budget  preparation,  policy  formulation, 
etc.,  which  implies  structuring  (questionnaire-type  or  otherwise). 
On  the  other  hand,  public  use  implies  a very  loose  structure  of 
the  type  we  are  now  using,  where  anybody  can  talk  at  any  time,  and 
subjects  are  only  determined  by  consensus. 

A : 

Mr.  R states  his  primary  concern  is  more  with  communication  with  a 
special  segment  of  the  public,  i.e.,  ^ity,  county,  and  state  plan- 
ners and  decision-makers  who  have  need  of  USGS  data  and  informa- 
tion, but  do  not  know  our  language  or  h^w  to  obtain  the  informa- 
tion they  need. 

fi  : 

Structure  comes  through  now,  Jacques.  Thanks. 

MILLER  (Chrmn;  : 

But  if  -hey  are  in  dialogue  with  a member  of  your  group,  even  if 
the  means  is  FORUM,  don't  they  have  access  to  the  terminology  and 
to  aid  in  making  requests? 

A : 

In  reply  to  your  comment,  Rich,  he  says  that  this  follows.  But  he 
would  add  that  history  has  shown  that  "expert"  professional  scien- 
tists such  as  we  have  here  are  greatly  remiss  in  communicating  with 
others.  He  feels  the  main  challenge  of  his  project  would  be  one  of 
"compressing"  large  volumes  of  data  in  a "digestible"  and  meaning- 
ful form  for  the  person  who  would  have  use  of  the  data  (change  "re- 
miss" to  "awkward"  or  "clumsy")....  This  implies  large  use  of 
graphic  and  map-like  displays. 

A : 

However,  there  is  no  way  to  avoid  the  use  of  large  bodies  of  words 
also.  I should  add  that  Mr.  R's  principal  interest  is  NOT  in  im- 
proving the  organi zat iooal  efficiency  or  ef feet i veness . . . the  re  are 
a number  of  others  who  have  this  as  a primary  concern.  He  is,  as 
• I think  has  become  apparent,  more  interested  in  the  "public"  that 
the  project  serves. 


I 

I 
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VALLEE  : 

Can  one  do  what  you  propose  by  software  alone?  It  seems  that  it 
will  not  be  enough  to  give  people  access  to  the  data,  you  have  to 
give  them  a simple  link  to  someone  who  can  interpret  the  data  for 
them. 

A : 

Exactly  so,  Jacques. 

A : 

This  leads  Mr.  R to  feel  that  the  REAL  potential  with  something 
like  FORUM  would  be  to  link  the  local  "expert"  or  would  act  as  a 
link  between  the  local  expert  and  larger  systems  or  other  experts 
and  the  person  in  need  of  information. 

MILLER  (Chrmn)  : 

That  sounds  like  an  information  clearinghouse  for  geologists.  Is 
this  function  needed  often  in  the  time  frame  that  FORUM  provides? 
That  is,  how  often  is  dialogical  real-time  communication  of  this 
type  necessary  in  your  group  or  by  your  group  for  the  outside 
pub  lie? 

VALLEE  : 

Remember  that  the  problem  calls  for  more  than  a traditional 
clearinghouse.  The  question  from  a user  might  involve  more  than 
can  be  answered  locally.  Having  an  on-line  community  of  experts 
would  make  it  possible,  say,  for  an  expert  in  Washington  to  reply 
to  a question  from  Texas. 

A : 

Rich,  Mr.  R states  that  we  are  looking  more  at  an  ENVIRONMENTAL 
CLEARINGHOUSE  RATHER  THAN  A PURELY  LOCAL  ONE.  Most  of  the  dead- 
lines are  in  ;«  time  framework  of  months;  (e.g.,  for  planners  and 
decision  makers)  rather  than  rapid  turn-around. 


D.  FORUM  CONFERENCES  0 N THE  ARP  A NETWORK 

Figure  13  shows  the  growth  of  two  user  conferences  that  were  set  up  on 
ARPANET  in  October  1973  for  the  purpose  of  exploring  the  software  issues 
raised  by  FORUM  with  interested  and  competent  parties  at  various  ARPANET 
sites.  Those  two  conferences  were  created  on  the  basis  of  our  experience 
with  a wider,  public  exchange  that  had  taken  place  in  August  and  September 
and  had  involved  a very  large  range  of  reactions  both  to  FORUM  itself  and 
to  the  overall  context  of  teleconferencing.  With  the  availability  of  re- 
lease 5 of  FORUM  in  October,  this  public  conference  was  discontinued  and 
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rtplaced  by  two  specific  discussions  among  a smaller  group  of  participants 
who  were  directly  involved  in  teleconferencing  at  the  design  level.  The 
conference  shown  in  Figure  12  as  "USERS:  1"  dealt  with  specific  reactions 
to  FORUM  and  was  limited  to  contributors  with  many  hours  of  actual  Experi- 
ence with  the  medium  (most  of  them  were  from  USC/ISI) , while  the  "USERS:  2" 
conference  centered  on  the  associated  design  problems. 

During  the  period  of  October  to  February  shown  in  these  statistics, 
participants  using  the  two  conferences  made  a total  of  380  entries.  The 
rate  of  increase  in  the  number  of  entries  is  again  correlated  with  the  syn- 
chronous nature  of  some  phases  of  the  discussion,  as  reflected  especially 
in  the  USERS:  2 conference  for  9 January  1974,  when  three  users  exchanged 
design  ideas  in  a fast  brainstorming  session. 

Typical  of  the  synchronous  exchange  is  this  part  of  the  transcript, 
in  which  two  users,  who  had  previously  been  arguing  in  asynchronous  mode 
about  conference  structures  in  FORUM,  happened  to  be  on  the  system  at  the 
same  time.  (The  reader  will  notice  that,  unlike  preceding  examples  which 
were  based  on  FORUM-4,  the  messages  here  are  numbered  and  have  date  and 
time  stamps.  These  features  were  added  in  release  5.) 

• [71]  HI  LLER(Chrmn)  WED  9-JAM-74  5 : ^7PM 

Hi  Wally.  What  would  you  like  to  talk  about? 

• 

[72]  RYDER  WED  9-JAH-74  5:/*7PM 

• Rich,  I think  1 would  like  to  add^ss  an  earlier  entry  I made  on 

security  first.  Because  of  the  ety  of  different  sources  and 

• kinds  of  sensitivities  to  inforr  * .i,  it  seems  that  unless  a sim- 

ilar variety  of  security  measures  is  available  important  stimuli 

• are  net  going  to  be  broadcast  over  this  medium. 

• [73]  RYDER  WED  9-JAN-74  5:51PM 

What  I propose  is  a discussion  of  the  variety  of  security  measures 

• that  might  be  provided. 

• [74]  Ml  LLER  (Chrmn)  WED  9-JAN-7**  5:52PM 

R 72 

• I agree.  Have  you  been  advised  as  to  the  security  measures  that 
are  be*ng  taken  in  release  6? 

• 

[75]  RYDER  WED  9-JAN-7^  5:53PM 

• No.  Or  rather  only  briefly.  Can  you  help  me? 


Total  FORUM  Entries 


i 

i 


November  1973  December  January  1 97^ 


Figure  12.  Growth  Curve  for  User  Conferences 
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[76]  HlLLER(Chrmn)  WED  9-JAN-7A  5:5APM 

Yes.  Let  me  outline  what  we‘ve  got  in  mind  and  then  you  can  tell 

me  wha t we've  left  out. 

[77]  Ml LLER  (Chrmn)  WED  9-JAN-7**  5:5**PM 

First,  release  6 wi 1 1 incorporate  a password  system  such  that  each 
user  will  have  a unique  password  under  his  control  and  which  will 
allow  access  only  to  those  persons  who  know  the  password.  A pri- 
vate message  file  wi 1 1 be  constructed  for  each  user,  so  that  they 
are  retrievable  and  deletable  under  the  user's  control. 

[78]  Ml  LLER  (Chrmn)  WED  5-JAN-7**  5:57PM 

The  new  system  will  allow  any  user  to  set  up  a conference,  so  no- 
body from  the  Institute  even  has  to  know  of  the  existence  uf  a con- 
ference. There  will  still  be.  the  problem  of  getting  a text  file 
dumped  out  which  will  contain  the  text  of  a conference  but  the  only 
people  who  will  be  able  to  do  this  will  be  people  with  "wheel"  ca- 
pability and  those  programmers  at  the  Institute  who  know  the  loca- 
tion and  the  password  for  the  directory  that  holds  the  conference 
f i les . 


That's  about  it.  Should  I be  more  specific? 

[79]  RYDER  WED  9-JAN-7A  6 :04PM 

How  do  you  plan  on  handling  the  problem  of  different  levels  of 
clearance  within  a set  of  participants? 

[80]  M I LLER  vChrmn)  WED  9-JAN-7A  6:07PM 

The  only  "clearance"  capability  is  the  following:  you  can  create 

a discussion  within  a conference  and  "deassign"  that  discussion 
for  a participant.  In  other  words,  you  can  send  private  messaces 
to  a group  of  participants  in  a discussion  or  ^u  can  lock  a par- 
ticipant out  of  a discussion  altogether. 


[81]  RYDER  WED  9-JAN-7';  6:12PM 

I wonder  how  to  evaluate  the  cost  of  not  having  "all"  participants 
be  able  to  respond  to  whatever  stimuli  they  are  permitted  to  see, 
especially  in  a non-real -t ime  medium  like  this.  It  seems  that 
mask-*  might  be  able  to  buy  back  some  of  that. 

[82]  MILLER  (Chrmn)  WED  9-JAN-7A  6:15PM 
Hold  on.  Phone  call. 


[83]  M I LLER (Chrmn)  WED  9-JAN-7**  6:»9PM 

Wally,  what  type  of  "classified"  mess; ge  system  would  be  more 
su i tab  1 e? 


[8A]  RYDER  WED  * IAN-7**  6:21PM 

Let  me  try  to  expla.r  ny  simple  model  of  the  system.  Unless  I'm 
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just  using  the  conference  to  inform,  the  fundamental  purpose  is 
J.o  make  concepts  articulate.  For  that  purpose,  and  hecause  we  are 
so  ignorant  of  the  mechanisms  that  make  that  process  work,  when  it 
does,  and  to  whatever  degree  it  does,  the  closer  to  a shot-gun  ap- 
proach you  take  to  provide  as  many  servers  that  stimuli,  the  bet- 
ter. Think  of  it  as  a queueing  problem.  As  a consequence,  if  the 
different  kinds  of  information  were  coded  according  to  who  can 
read  it  (the  classical  problem  of  classification,  except  this  can 
always  be  done,  if  desired  in  small  packages)  then  as  many  servers 
as  possible  (out  of  the  original  set)  could  respond. 

[85]  MlLLER(Chrmn)  WED  9-JAN-74  6:32PM 

Are  you  talking  about  who  gets  the  entry  or  how  soon  one  gets  the 
entry  when  you  mention  the  queueing  problem?  If  it's  the  latter, 

I don't  know  the  answer  other  than  sending  private  messages  with 
the  higher  priority  and  regular  messages  with  the  standard  priority. 

[86]  RYDER  WED  9-JAN-7**  6:35PM 

What  I meant  by  the  queueing  problem  in  [84]  is: 

l.  Stimuli  repres-  nting  concepts  to  be  discussed  are  generated  by 
part ic i pants . These  are  to  be  processed  by  other  participants  in 
one  or  more  of  several  ways  (e.g.:  (a)  acknowledged  that  the  rep- 

resentation adequately  covers  the  concept  and  agreement  (under- 
standing) is  accomplished;  (b)  the  representation  of  the  concept 
is  inadequate,  and  paraphrase,  refutation,  or  some  other  appropri- 
ate response  is  generated;  and  (c)  a new  concept  is  triggered  in 
the  mind  of  the  receiver,  and  he  begins  to  attempt  to  articulate 
it) . 


2.  The  receiver  responds  to  the  stimuli  (i.e.,  the  demand  is 
serviced) . 

That's  the  queueing  system  I had  in  mind. 

[87]  Ml LLER (Chrmn)  WED  9-JAN-74  6:46PM 

I see,  but  what  prevents  that  type  cf  use  now  in  FORUM?  If  you 
want  an  automatic  chairman  that  operates  under  modified  Roberts 
Rules  of  Order,  one  could  structure  the  interchange  with  giving 
the  floor  to  a participant,  allowing  questions  and  challenges, 
etc.  but  I have  the  feeling  that  this  solutio.,  would  be  more  cum- 
bersome for  the  task  at  hand. 


After  this  synchronous  exchange,  a third  user  cane  into  the  system,  and  as 
he  reviewed  tile  past  entries  to  catch  up  with  the  ongoing  discussion,  the 
first  participant  had  to  leave.  The  conference  continued  as  follows. 


• [102]  MILLER  (Chrmn)  WED  9-JAN-71*  7:24PM 

If  what  you  are  saying  has  penetrated  my  thick  skull,  you  want 

• something  that  would  allow  me  to  designate  groups  of  participants 

and  then  send  messages  to  groups  at  my  command,  like  (to  group,!) 

• but  not  group  2,  or  to  groups  1 and  2,  but  not  group  3-  Right7 

• [103]  VALLEE  WED  9-JAN-74  7:26PM 

Sounds  like  it  requires  an  I DENT  system. 

[104]  RYDER  WED  9-JAN-74  7:27PM 

• RE:  102  right.  RE:  103  ident?  Help  me. 

• [105]  VALLEE  WED  9-JAN-74  7:28PM 

This  implies  a sophisticated  mechanism  for  identifying  everybody. 

• We  have  tried  not  to  introduce  a concept  of  large  user  file  in 
FORUM. 

[106]  M 1 LLER  (Chrmn)  WED  9-JAN-74  7:29PM 

• I'm  afraid  I'm  going  to  have  to  quit  this  for  now. 

• [107]  VALLEE  WED  3-JAN-74  7:30PM 

Wally,  l haven't  caught  up  with  the  previous  discussion  yet,  but 

• are  you  suggesting  that  a mechanism  should  exist  for  designating 
subgroups  within  a conference?  Across  conferences? 

[108]  RYDER  WED  9“ JAN-74  7:30PM 

• RE:  106 

I understand,  i 'm  beginning  to  get  giddy  myself.  I really  can't. 

• stand  typing.  Thanks  Rich.  Good  te  i k » ,.g  to  you. 

• [109]  RYDER  WED  9-JAN-74  7:32PM 

Both,  J.,  I'm  concerned  with  obtaining  the  maximum  flexibility  in 

• a security  mechanism  without  having  to  write  the  number  of  re- 
spondents that  can  serve  an  entry. 

[11C]  VALLEE  WED  9-JAN-74  7:36PM 

• Is  this  in  the  context  of  a discussion  with  human  users  or  of  a 
simulation  or  model  building?  In  the  case  of  human  users  there  is 

• a danger  of  such  a mechanism  getting  in  the  way. 

• [111]  RYDER  WED  9" JAN-74  7:37PM 

RE:  110 

9 Human  users.  I don't  know  how  much  the  "getting  in  the  way"  is  a 
tactical  design  problem.  Security  problems  themselves  inhibit 

• communication.  What  ! am  concerned  about  is  an  articulation  of 
the  trade-off  that  is  inputted  in  any  system  between  the  compl ica- 

9 tion  of  the  security  mech.  in  the  system,  that  that  covers  for  the 
lack  of  one  in  the  user's  mind,  and  the  cost  of  failing  to  have 
9 one  because  it  wasn't  covered  anywhere. 
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[112]  VALLEE  WED  9-JAN-74  7-^PM 

RE:  111:  How  do  other  participants  become  aware  of  a group’s 

name,  existence?  Is  this  a chairman  (or  what  we  now  call  "orga- 
nizer1') function? 

[113]  RYDER  WED  9-JAN-7**  7:A6PM 

RE:  112 

Sure.  I don't  know  what  would  be  the  matter  with  letting  the  orga- 
nizer be  responsible  for  which  combinations  of  participants  had 
what  security  options. 

[llA]  VALLEE  WED  9-JAN-71*  7:^7PM 
RE:  110 

I can  see  more  need  for  this  in  modeling  where  group  names  might 
designate  sets  of  modules  under  program  control. 

[115]  VALLEE  WED  9-JAN-71*  7:50PM 

Should  the  organizer  be  the  only  one  though?  Why  not  let  every 
user  designate  the  groups  he  can  address  his  messages  to?  I won- 
der what  a facility  like  that  would  do  in  a synchronous  discus- 
sion. It  might  encourage  fractioning  of  the  rain  conference  and 
some  users  would  gradually  get  the  feeling  of  being  "left  out", 
probably  rightly  so!  In  asynchronous  mode,  though,  this  would  be 
a nice  way  to  have  a notification  system.  We  have  to  think  about 
that  one. 

[116]  RYDER  WED  9-JAN-72*  7:52PM 

RE:  11A 

That's  interesting;  I hadn't  considered  it.  Isn't  it  a different 
secur i ty  probl em? 

[117]  VAluEE  WED  9-JAN-74  7:55PM 

RE:  116 

Same  basic  problem,  I think.  Under  release  6 participants  wi  1 1 
manage  their  own  private-message  file,  so  the  burden  for  protect- 
ing the  file  is  on  then. 

[118]  RYDER  WED  9-JAN-7*  7:56PM 

RE:  117 

That  should  answer  part  of  the  problem  on  this  system,  if  they 
ever  handle  the  "group"  code  problem. 

[119]  M I LLER  (Chrmn)  TH'J  IO-JAN-7A  10:39AM 
To  al 1 part icipants  : 

Does  it  meeJ  with  anyone's  approval  or  disapproval  to  set  up  an 
additional  activity  on  the  subject  of  security  and  malleable  pat- 
terns of  interconnection,  as  was  suggested  in  the  conversation 
among  Mssrs.  Ryder,  Vallee,  and  Miller?  Please  let  me  know  soon, 
e since  I'll  set  it  up  if  I don't  hear  any  grumblings. 


[120]  VALLEE  THU  10-JAN-7**  11:00AM 

Rich,  an  alternative  to  setting  up  another  activity  might  be  to 
just  identify  this  as  a theme  we  could  refer  to  in  later  discus- 
sion. Having  to  go  into  another  activity  is  quite  constraining. 

[121]  MILLER(Chrmn)  THU  10-JAN-7**  1 l :04AM 

I agree  that  it  is  a constraint  to  subdivide  the  discussion,  but 
there  seems  to  be  a problem  with  mixing  all  the  discussions  into 
one  giant  heap.  Possibly  we  should  wait  for  a while  to  see  how 
the  discussion  goes.  One  thing  that  might  solve  all  the  problems 
is  a means  of  p"tting  in  an  “expanding  table  of  contents"  such 
that  users  would  know  at  a fast  glance  where  the  discussions  rel- 
evant to  their  immediate  interests  are.  The  review  by  first  n 
lines  helps,  but  doesn't  do  the  full  job. 

[122]  GREENFELD  THU  10-JAN-71*  11:19AM 

Cne  can  look  on  the  confused  threads  of  the  past  AO  messages  as  a 
very  good  example  of  the  needs  and  operational  characteristics  of 
a teleconferencing  system.  At  some  point,  (l  believe  about  mes- 
sage 110),  the  impatience  with  the  medium  became  so  great  that  at 
least  2 splinter  conversations  got  started.  While  it  may  have 
been  unders tandab 1 e to  the  participants  (was  it?),  to  a later  ob- 
server it  is  difficult. 

I should  think  that  the  need  for  very  flexible  structuring  in  all 
the  guises  of  "activities"  and  "message-receiving"  groups  etc.  is 
now  obvious.  The  questions  that  need  discussion  are  whether  these 
structuring  methods  should  be  done  at  the  time  of  message  genera- 
tion (e.g.,  security)  or  at  the  time  of  reception  (e.g.,  current 
string  search)  or  both,  or  which  types  of  structure  which  ways.... 
That  is,  this  is  the  kind  of  meta-structure  rule  which  will  de- 
termine whether  the  structuring  activities  will  “get  in  the  way" 
or  be  enhancing  of  communication. 

[123]  MANN  THU  10-JAN-7**  3:29PM 

There  are  applications  for  post  hoc  topical  structure  as  well  as 
on-the  fly  organisation  of  activity.  For  example,  I may  want  to 
review  a series  of  suggestions  via  a structure  which  represented 
whose  money  was  to  be  spent  for  each  suggestion,  even  if  that  as- 
pect never  came  up.  So  l may  want  to  impose  my  own  thread  struc- 
ture afterwards. 

Reviewing  by  somebody  elbo's  thread  structure  is  a useful  looking 
index  means.  It  is  attractive  because  FORUM  encourages  fragmen- 
tation of  a discussion  rather  than  serial  consideration  of  topics, 
9 as  would  be  comron  in  a face-to-face  conference.  The  proper 
thread  structure  is  often  one  object  of  negotiation.  AN  AGREED 
• UPON  SLT  OF  TOPICS  SHOULD  NOT  ALWAYS  BE  A PRECONDITION  FOR 
PROCEEDING. 
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The  remark  by  Gtreenfeld  (in  entry  #122)  that  two  splinter  discussions  took 
place  simultaneously  after  entry  #110  is  an  observation  that  can  be  general- 
ised to  most  of  our  synchronous  conferences,  where  participants  commonly 
fall  into  the  pattern  of  conducting  several  threads  of  discussion  at  the 
same  time.  Later  identification  ani  review  of  these  threads  is  an  intrigu- 
ing problem  that  will  have  to  be  faced  in  future  versions  of  FORUM. 

Another  user  conference  was  implemented  for  the  purposes  of  allowing 
rapid  dialogue  and  solving  technical  problems  between  the  FORUM  designers 
and  the  major  users  of  the  system.  An  excerpt  that  is  typical  of  the  dis- 
cussion is  given  below  as  an  illustration  of  the  degree  of  detail  of  these 
exchanges. 


[37]  BAUER  WED  3 1 -OCT-73  ^ : 3 1 PM 

HE:  Message  Presentation 

On  entering  this  conference,  I was  told  that  n messages  had  been 
entered  since  I was  last  here  and  did  I want  to  see  them.  I said 
yes,  ond  got  them  in  order  correctly  except  for  the  last  one  which 
came  out  after  the  message  "YOU  HAVE  SEEN  THE  35  ENTRIES  MADE  SO 
FAR(CR)  IK  YOU  MEED  HELP..."  Hot  only  that,  but  it  (message  35) 
came  out  wi  thout  a time  or  date  stamp. 

[33]  6ALZER  WED  31 -OCT-73  4:37PM 
RE:  Use  of  JOIN  Command 

In  suite  of  the  message  about  the  use  of  JOIN  (message  33),  I just 
tried  it  and  it  was  not  recognized.  On  reflection,  I assume  it  is 
because  I have  been  using  F0F?>UM  for  many  hours  and  my  copy  is  the 
old  unmodified  version.  If  I got  cut  of  FORUM  and  obtained  a 
clean  copy,  I suspect  (and  hope)  JOIN  would  be  recognized.  How- 
ever, if  I were  a non -conpu te r user,  I probably  wouldn't  under- 
stand about  copies  of  programs  and  would  wonder  about  the  compe- 
tence of  the  system  builders  whose  comments  about  new  good  fea- 
tures didn't  work! 

[39]  BALZER  WED  31  “Of  T-/3  4:43P M 

RE:  Previous  Message 

As  1 suspected,  all  is  better  now  that  I have  the  current  copy  of 
the  program.  It  works  as  advertised. 

[40]  L I P I NS hi  WED  31 -OCT-73  8:33PM 

RE:  37  by  Bob  Balzer  on  message  presentat ion . Message  35  by  Nor- 

ton Greenfeld  was  put  at  the  same  time  you  were  in  FORUM,  i.e.,  as 
you  were  catching  up  on  the  entries  you  had  not  seen.  Thus  FORUM 


• did  not  put  a date  and  time  stamp.  You  caught  FORUM  at  the  trans- 
ition between  synchronous  and  asynchronous  operation.  In  synch ron- 

• ous  operation  it  does  not  put  the  time  stamps  since  it  doesn't 
make  sense  then.  By  the  way  the  fact  that  you  keep  getting  the 

• "IF  YOU  NEED  HELP"  message  is  a bug.  It  is  supposed  to  print  only 
the  first  2 times  you  ever  use  a conference.  This  will  be  fixed, 

• as  soon  as  I can  since  it  is  starting  to  bother  me  and  I'm  sure 
you  also. 

• [b\]  LIPINSKI  WED  31 -OCT-73  8:53PM 

Hopefully  the  confusion  in  choosing  conferences  will  be  somewhat 

• ieduced  since  FORUM  now  displays  all  conferences  you  may  attend, 
instead  of  the  private  and  public  (that  you  haven't  joined  yet) 

• distinction  it  made  before.  The  ability  to  obtain  direct  com- 
ments and  specific  reactions  from  users  of  the  system  shortened 

• drastically  the  reaction  time  to  suggestions  for  improvement  of 
the  system.  It  also  served  in  increasing  the  acceptance  of 

• FORUM  among  our  user  population  on  the  network. 


IV.  CONCLUSION 


A.  MAJOR  F1KDING3 

In  the  course  of  this  project,  we  have  learned  how  to  use  a computer 
network  in  support  of  a fundamental  decision-making  activity,  the  structur- 
ing and  conduct  of  conferences.  The  research  issues  addressed  in  this  ac- 
tivity fall  into  two  categories.  First,  from  a computer  science  viewpoint, 
the  development  of  file  structures  to  support  conferences  raises  design  is- 
sues that  we  have  identified  and  solved  in  the  course  of  our  experimentation 
Essentially,  the  file  structures  must  allow  many  users  to  share  thorn  simul- 
taneously, and  programming  of  terminal -oriented  capabilities  must  be  de- 
signed to  make  the  machine  as  flexible  as  possible.  Second,  from  a human- 
factors  viewpoint,  our  research  has  invo,  1 the  identification  of  certain 
basic  principles  of  communication  in  the  computing  environment  and  the  cre- 
ation of  methods  for  displaying,  in  a meaningful  way,  both  tha  contents  and 
the  dynamics  of  the  communication. 

Synchronous  (simultaneous)  confeicnci ng  poses  problems  that  have  not 
been  observed  before  by  computer  scientists*  Research  on  conferencing  under 
any  communication  medium  must  begin  with  an  understanding  of  the  social 
processes  within  which  the  discussion  or  encounter  takes  place.  Careful  ob- 
servation of  group  discussion  has  combined  with  tradition  to  provide  certain 
rules  for  conducting  meetings.  Typically  reflected  in  the  adversary  process 
of  a court  of  law,  in  parliamentary  debate,  and  in  Robert's  Rules  of  Order, 
tnis  tradition  demands  that  the  floor  be  given  to  each  side  in  turn,  and  pro 
vides  methods  for  handling  motions,  suggestions,  and  the  presentation  of 
evidence.  The  availability  of  a computer  as  a tool  to  structure  this  inter- 
action opens  up  new  capabilities.  But  at  the  same  time,  the  classical  text 
processing  techniques  do  not  satisfy  the  needs  of  the  participants  in  such 
a conference.  A programming  effort  aimed  solely  at  providing  users  with  an 
array  of  new  commands  for  indexing,  keywording,  and  defining  threads  in  the 
course  of  the  dialogue  is  clearly  not  the  answer. 
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As  a teleconferencing  system,  FORUM  has  unique  characteristics  not  typ- 
ical of  other  computer  systems.  Of  primary  concern  in  its  development  have 
been  the  techniques  of  translating  the  perceived  flow  of  a face-to-face  dis- 
cussion into  the  medium  provided  by  the  computer.  The  information  flow  in 
a synchronous  conference  is  now  well  displayed  by  FORUM. 

Other  concepts  implemented  in  FORUM  are  the  handling  of  private  and 
anonymous  messages  and  the  ability  to  access  system  services  while  in  a con- 
ference. This  treatment  of  conference  activity,  which  facilitates  social 
interaction,  is  unique  to  FORUM. 

The  ability  of  a participant  to  join  an  activity  in  an  asynchronous 
manner  has  created  an  unforeseen  demand  on  the  system:  the  need  to  review 

past  entries,  add  new  comments  or  ideas,  or  suggest  changes,  for  example, 
plays  a more  significant  role  than  had  been  anticipated. 


Fi_. FUTURE  DIRl-iCTIOhS 

The  long-range  goal  of  the  teleconferencing  project  at  the  Institute  is 
the  development  of  a group  communications  tool  based  on  computer-science  con- 
cepts. In  the  course  of  this  initial  effort,  we  have  created  a teleconfer- 
encing system  that  we  have  now  been  able  to  observe  in  over  twelve  months  of 
actual  operation.  It  is  still  very  primitive  in  several  respects:  first, 
the  implicettions  of  synchronous  (simultaneous)  conferencing  remain  largely 
unknown,  both  in  terms  of  computer  support  of  thought  processes  and  in  terms 
of  user  behavior;  second,  the  possibility  of  multimedia  (audio  and  video) 
adjuncts  to  the  computer  conferences  has  hardly  been  explored. 

Much  of  our  work  to  date  has  consisted  in  inventing  data  structures  and 
access  mechanisms  suitable  for  the  use  of  computers  as  a communication  medium. 
We  have  encountered  two  major  technical  obstacles  in  this  respect. 

1.  Ordinary  compute* r architecture  creates  severe  limitations  for 
our  conferencing  needs.  Teleconferencing  will  require  a revi- 
sion of  the  organization  of  various  computer  resources  in  order 
to  make  efficient  communication  among  many  users  possible. 

2.  Ordinary  concepts  .in  file  processing,  that  rely  en  separation  of 
us‘*r  files  and  access  paths,  do  not  apply  in  the  conferencing 
environment.  Vfe  have  found  that  a single  user,  namely  FORUM 
itself,  had  to  have  complete  access  control.  This  leads  to  an 
unusual  situation  in  terms  of  privacy,  protection,  and  account- 
ing. 


An  extremely  rich  domain  for  further  research  has  been  identified  in 
the  course  of  this  effort.  The  specific  computer-science  questions  it 
addresses  (leaving  aside  the  entire  field  of  social  impact  and  psycholog- 
ical reaction  to  the  medium)  follow. 

• How  can  conferencing  be  interfaced  with  other  functions  shown  in 
Figure  CA,  especially  in  the  area  of  text  editing  and  fact 
retrieval? 

• How  can  a mechanism  be  provided  for  the  identification  of  semantic 
threads  and  subgoals  in  a discussion? 

• How  can  the  knowledge  of  man/machine  interaction  be  adapted,  or 
extended,  to  a nonclassical  situation  of  computer-mediated  group 
communication  (man/machine/man  interaction)? 

• How  can  a conferencing  program  be  offered  at  a very  high  level  of 
reliability  over  a network  where  actual  processing  of  the  conference 
activity  becomes  machine-independent? 

When  computer  communication  becomes  more  widespread,  we  foresee  a num- 
ber of  new  problem  areas  that  deserve  careful  exploration.  One  of  these 
areas  involves  the  coupling  of  conferencing  activities  to  other  functions, 
such  as  document  preparation  and  publication,  that  are  equally  vital  to  the 
management  task.  Another  is  the  definition  of  retrieval  functions  capable 
of  operating  on  what  is  basically  an  unstructured,  unindexed  data  base.  Yet 
another  area  deals  with  the  adaptation  of  the  computer  t -»  the  needs  of  an 
office;  e n ■ vi  r o n me  n t . 

In  considering  the  last  point,  it  is  useful  to  remember  that  manage- 
ment information  systems  have  largely  failed  because  their  assimilation  _n 
the  framework  of  an  executive’s  activities  present  too  high  a threshold  in 
terns  of  training,  usage  patterns,  and  restriction  of  information  types. 
Poliabi 1 i ty  and  privacy  are  at  the  top  of  the  list  of  the  requirements  for 
a successful  system,  and  these  must  be  addressed  immediately.  It  is  unlikely, 
however,  that  certain  constraints — for  instance,  the;  need  to  type  on  a key- 
Loard--v;LLl  he  removed  within  the  next  ten  years.  Human  factors  aspects  of 
software  design  have  be»*n  generally  neglected;  under  these  conditions,  we 
feel  that  considerable  attention  should  be  devoted  to  psychological  and 
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social  factors  before  any  attempt  is  made  to  introduce  teleconferencing  into 
a large,  operating  environment. 

Another  aspect  of  teleconferencing  that  requires  further  examination 
on  the  basis  of  the  trends  we  have  already  observed  concerns  the  trade-off 
between  travel  and  communication.  Writing  in  the  February  1974  issue  of 
Telecommunications , Paul  Polishuk  has  stated  that: 

"The  Office  of  Telecommunications  believes,  based  on  analyses  con- 
ducted to  date,  that  as  much  as  5 percent  of  the  total  annual  petro- 
leum consumption  in  the  United  States  can  be  saved  by  substituting 
telecommunications  for  the  transport  of  people  and  goods." 

While  our  own  project  intends  to  explore  these  substitution  possibili- 
ties further,  experience  with  the  FORUM  medium  leads  us  to  consider  as 
equally  exciting  the  opportunity  to  regard  computer  conferencing  as  a genu- 
inely new  way  for  groups  to  exchange  ideas,  to  do  planning,  and  to  arrive 
at  decisions,  especially  relevant  in  this  respect  are  the  observations  by 
Arthur  Hastings  that  "FORUM  conferencing  at  the  Institute  clearly  resulted 
in  staff  members  having  a common  ground  for  communicating"  and  that  "the 
highest  proportion  of  entries  in  any  category  (in  the  staff  meeting)  is  from 
reports  made  while  traveling."  If  a communication  framework  can  be  main- 
tained, and  even  enhanced,  while  member^  of  a research  groun  or  management 
team  are  physically  separated  by  large  distances  (as  in  the  situations  we 
have  observed) , then  a major  change  in  work  styles  and  intellectual  patterns 
seems  possible.  Such  a change  may  be  even  more  significant  in  the  long  run 
than  the  energy  savings  which  teleconferencing  may  provide  in  the  near 
future . 
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APPENDIX  1:  FORUM  USER  GUIDE 


A.  JOINING  A FORUM  ACTIVITY 


The  ARPANET  environment  demands  that  a user  connect  his  terminal  to  a host 
computer  through  the  following  actions. 

Lial  the  TIP  number;  wait  for  high-pitched  tone;  and  place  phone  in  ac- 
coustic  coupler.  Both  terminal  and  coupler  should  be  set  for  FULL  and 
30  cps. 

2.  Type  everything  printed  bi  ~s,  leaving  spaces  where  they  are 

shown  and  ending  each  line  with  one  carriage  return  [CR] . 

i 

Hello. . . 

3D  C E [CR] 

0L  xxfCRj|  where  "XX"  is  the  number  of  the  host  computer 

ISI-TENKX . . . 

g|lcg  [DIRECTORY  name]  [PASSWORD]  [ACCOUNT]  [CR]| 

JOB 

C I IuiAME>F0RU M [CR]|  where  "DIRNAME"  is  the  specific  directory 

This  will  start  the  FORUM  program.  You  will  be  asked  for  your  last  name 
and  information  concerning  terminal  equipment  you  are  using. 

You  will  then  get  a list  of  the  conferences  available  to  you.  If  you  choose 
none  of  these,  the  FORUM  program  will  automatically  return  you  to  the  TENEX 
executive.  (Note  that  if  you  are  using  the  CHAIRMAN  program,  you  may  opt 
not  to  join  an  existing  conference,  and  will  be  given  a "COMMAND?"  prompt 
and  the  ability  to  set  up  a new  conference.)  If  you  are  registered  in  only 
one  conference,  FORUM  will  start  you  in  that  conference  automatically. 

Having  selected  a conference,  its  title  and  information  on  its  structure 
and  participants  will  be  printed.  Since  most  of  the  activities  in  a con- 
ference are  discussions,  the  following  sections  concern  themselves  with 
this  type  of  activity.  Other  activities  (e.g.,  eliciting  a number  or  a 
probability  estimate)  are  explained  by  FORUM  and  require  no  background  other 
than  that  obtained  by  typing  a question  mark  (?) . 


Making  an  Entry  in  a Discussion 

While  in  a discussion  you  may  make  an  entry  at  any  time — simply  start  typ- 
ing . To  end  an  entry,  strike  the  carriage  return  key  tCR]  twice.  See  in- 
structions for  editing  entries  on  pages  74  and  75. 


-61- 


Welcome  to  FORUM. 


Please  register  by  typing  your  last  name  and  then  striking  the  carriage 
return  (CR)  key. 

- Green 

Good.  Are  you  using  a terminal  that  prints  on  paper?  Please  type  V for 
YES  or  N for  NO  and  then  strike  the  carriage  return  (CR)  key. 


You  nay  attend  any  one  of  the  following  conferences: 

1 System  Oesign  Conference 

2 Staff  Conference 

J Department  Directors  Meeting 

Please  type  the  number  of  the  conference  you  wish  to  join  ana  then  strike 
the  carriage  return  (CR)  key. 


The  title  of  the  conference  is: 

Department  Directors  Meeting 

Background  i n format • on : 

This  confe rence  wi 1 1 include  discussion  activities  and  other  information 
elicitation  activities  for  the  meeting  of  department  directors. 


The  participants  in  the  conference  aie: 


not  on-l ine 
entering 


1 Smith  (Chrmn)  not  on-line  3 Brown  not  on-l 

2 Jon^s  not  on-line  Green  entering 

The  topics  in  the  a.  ends  are: 

i 

1 Budget  estimates 

2 feedback  from  budget  estimates 

3 Discussions  of  n«-*  projects  th.it  should  be  added  in  the  nest  year. 


Agenda  topic  I 
Budget  CitirvitCs 

Activity  I . I 

What  is  your  high  estimate  for  the  amount  of  fording  you  will  need  for 
project  operations  this  year?  Answer  in  thousar.ds  of  dollars. 


l , •»  . > -•&  *.»  *f.  > - 


Figure  13.  Entering  a FORUM  Conference 
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Making  an  Anonymous  Entry  in  a Discussion 

Begin  your  message  by  striking  the  exclamation  point  [!j.  (Note  that  "l" 
must  be  the  first  character  typed.)  Type  your  message  as  you  would  for  a 
standard  entry,  ending  it  with  two  carriage  returns  [CRJ  . 


Sending  a Private  Me  . age 

Begin  your  message  by  .ping  a left,  parenthesis  ((]  as  the  fizst  character 
typed.  FORUM  will  automatically  print  the  word  "to".  You  should  then  en- 
ter the  name  of  the  recipient  of  your  message,  followed  by  one  carriage  re- 
turn [CR] . FORUM  will  prompt  you  for  your  message  with  a hyphen  [-] . You 
may  then  begin  typing  t^e  message.  End  your  message  with  two  carriage  re- 
turns [CR]  . For  example: 

flto  [smitHiIlcr'i] 

- |There  will  be  a meeting  at  3:15  pm  on  'iuesdrvT  [CR]| 

- ICRli ■* 


Commands 


Two  means  of  accessing  FORUM  commands  are  available  in  release  5. 

1.  While  participating  i.i  a discussion  activity,  you  may  send  a private 
message  tc  FORUM  rather  than  a human  participant.  This  allows  you  to 
access  special  FORUM  services  without  leaving  the  discussion  activity. 
Once  the  command  action  is  taken  by  the  program,  you  arc  returned  to 
the  ongoing  discussion,  having  never  really  left  the  activity. 

2.  At  any  point  in  the  program,  you  may  g > to  the  upper-level  command  »de 
(in  which  you  have  a full  set  of  FORUM  commands)  by  striking  the  ESy  oe 
cr  ALTmode  key.  This  command  moda  removes  you  from  cny  conference  ac- 
tivity you  are  participating  in  and  prints  a prompt  to  your  terminal  as 
follows : 

COMMAND? 

* 

After  Jne  command  action  is  completed,  you  are  either  returned  to  the 
command  mode  (indicated  by  another  "COMMAND?"  prompt) , or  to  an  activity 
at  which  the  command  given  will  explicitly  place  you.  For  example: 

COMMAND? 

IgO  1 ( to  activity) 


* 


2 [CR]  1 
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B.  USER  FUNCTIONS 


Getting  Help  from  FORUM 

If  you  are  not  sure  what  action  Lo  take  at  any  time  during  a FORUM  confer- 
ence, strike  the  question  mark  key  [?]  as  your  first  letter  of  input. 


To  Leave  FORUM 


To  end  your  participation  in  FORUM,  simply  hang  up  your  telephone.  If  you 
want  to  remain  on  the  network  in  non-FORUM-related  work,  send  the  following 
private  message  to  FOSUM  itself: 


[flto  tFORUFfrrfCR 
- [QUIT  [CR 


Or,  if  you  are  in  the  upper  level  command  mode: 


COMMAND? 

* Iquitlcri; 

You  will  then  be  placed  into  the  TENEX  executive. 


Moving  from  One  A ctivity  to  Another 

To  leave  one  discussion  activity  and  go  to  another  in  the  same  conference, 
you  may  do  either  one  of  the  following. 

1.  Send  a private  message  to  FORUM  and  use  the  special  service  requests 
"GO  (to  activity)  N" , "NEXT  (activity)",  or  "PREVIOUS  (activity)" 

2.  Strike  the  ESCape  or  ALItnode  key  and,  after  receiving  a "COMMAND?" 
prompt,  use  the  same  commands  listed  above. 

For  example: 

Rite  (forum}  |[cr]1 
- 1n::xt1  (activity)l[CRj| 

or 

[$|  where  ESCapa  or  ALTmode  key  is  typed 

COMMAND? 

* iNKXTl  (activity) KCkil 


Editing  Entries 


Strike  the  back  arrow  to  erase  the  last  character  which  you  typed.  If  you 
strike  the  back  arrow  several  times,  the  corresponding  number  of  characters 
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will  be  erased.  (Be  sure  to  count  blank  spaces  between  words  as  characters 
when  doing  this.) 

Strike  the  DEL  or  kUBOUT  key  twice  to  erase  an  entire  entry.  For  users  ac- 
quainted with  TEN EX  conventions,  the  control  character  operations  for  pro- 
gram control  and  editing  are  accepted  within  FORUM. 


Stopping  Output 

You  may  stop  output  to  your  terminal  by  striking  the  DEL  or  RUBOUT  key  twice. 
The  FORUM  program  will  stop  printing  the  current  block  of  text  and  continue 
with  the  next  operation. 


C.  SPECIAL  FORUM  SERVICES 

While  in  a discu  sicn  activity,  you  may  gain  access  to  certain  special  FORUM 
services  by  sending  a private  message  to  FORUM  itself.  To  obtain  a list  of 
available  services,  send  the  following  message: 

|(lto  [forukHIcrII 


For  your  convenience,  each  service  is  described  below.  End  service  request 
with  one  carriage  return  (CRj  . 

1 . DESCRIBE 

Explains  the  use  of  the  other  services  on  the  list.  For  example: 

f(|to  |fqru:  j)  [[cR]  1 

- [DESCRIBE REVIKWlCRil 

or 

|(to^ORU;^([CR]l 

- [DESCRIBE  ALL  LCR] 

2 . STATUS  (of  participants) 

Provides  you  with  a list  of  the  people  registered  in  the  conference  in 
which  you  are  participating  and  the  current  status  of  each  one. 

3.  SUBMIT  (_f.Ux) 

Inserts  the  text  file  you  specify  as  your  next  entry  in  the  discussion. 
For  example: 


[ijco  fr-’ORu:^)  KcrjI 

- [SUBMIT  [(file)  | MYFILE.TXT  [CRl|  where  "MYF1LE"  is  the 

Your  file  has  been  submitted  as  entry  [40}  name  of  a text  file 

REVIEW  (entries) 

Retrieves  and  displays  the  entries  you  specify.  You  may  use  any  of  the 
following  options,  alone  or  in  combination: 

a.  "BY"  and  a list  of  participant  names  (or  the  word  "ALL")  . For 
example : 

0to  |FORU^[icRil 

- [REVIEW  (entries)  Iby  SMITH  [~CR]1 


1?  ORU  T’t)  [TcrTI 

- [REVIEW  [(entries ) [by  SMITH  AND  LEE  [CRll 

b.  "IN"  and  a list  of  entry  numbers  (or  the  word  "ALL").  For  example: 

Eb  (fqru>1)|[cr]| 

- ^REVIEW  ' (entries)  |IN  2,5-9 , 14  [CR3l 

c.  "LAST  N"  entries  (to  see  only  the  previous  entry,  simply  type  "LAST") 
For  example: 

Rko  |yoRu:-i)lrcR}| 

- |rkVIEV:  l(entrics)  [LAST  3 [CR]{ 

d.  "BEFORE",  "ON",  or  "AFTER"  a date.  For  example: 

Rlto  lioRur^lfCR]! 

- (REVIEW  (entries)  {BEFORE  1 1 -APR-7 3 [CRl  1 


Ecoj5»5j DEcjO  

- [REVIEW  |( entries)  [ON  4/17/74  [CRll 

e.  "RE"  and  a text  string  in  quotation  marks.  For  example: 

EhoEE^fissP  f 

-{REVIEW  {(entries)  |RS  "ENKRr.V " [OR]  j 


The  program  wi  ? 1 retrieve  all  entries  in  the  current  discussion  ac- 
tivity containing  that  text  string. 

If  you  do  not  wish,  to  ro/iew  the  complete  heading  and  text  of  the  en- 
tries you  nave  specified,  you  may  use  any  of  the  following  restrictions, 
ulon o or  in  combination: 


-C.G- 


a.  "BY  FIRST  LINE"  or 

b.  "NO  HEADING"  

C.  "NO  TEXT" 

For  example: 


"BY  FIRST  N LINES" 

this  suppresses  the  printing 
' of  the  author's  name,  date, 
and  time  stamp 


Rfco  |FORn:{)TicR)l  

- jp^VIEW  Kentries)  |3Y  SMITH  BY  FIRST  3 LINES  [CRH 
or 


-[REVIEW  ((entries) 


[BY  SMITH  ON  4/17/73  NO  HEADING  [CR][ 


5.  SAVE  (entries) 


Saves  the  entries  you  specify  by  placing  them  in  the  TENEX  text  file  you 
name.  To  specify  the  entries,  you  may  use  any  of  the  options  listed 
above  under  REVIEW  (entries) . For  example*. 


f(lto  iFORUrtkCRll  

- ISAVE  gentries)  IbY  SMITH  [CR]  1 
in  lFILNM.TXT  [CR J j (New  File)j[CR] 


confirm  that  this  is  a new 
file  by  typing  one  carriage 
return  [CR] 


Note  that  FILNM  is  the  name  given  to  the  file  for  this  example . 


To  append  entries  to  an  existing  text  file,  you  must  specify  the  file 
name  and  the  version  number  of  that  existing  file.  For  example: 


confirm  that  you  are  adding 
entries  to  the  old  version 
of  the  file  by  typing  one 
carriage  return  [CR] 

The  program  will  take  the  file  containing  the  entries  made  by  Smith  and 
append  the  entries  made  by  Jones. 

6.  GO  (to  activity) 


i uco  ir  . j liuKji  - 

- ISAVK  kentries)  ^Y  JONES  [CR]) 
in  [fILNM.TXT;!  [CRj [ (Old  Version)  |[CR] 


i 


Puts  you  into  the  activity  in  the  conference  which  you  specify.  For 
example : 

fop  |foruf)1[cr]1 
- IgO  l(to  activity)  [2  [CR]  1 
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The  title  nf  tne  conference  1%: 

Department  Directors  Met  tiny 

Background  information: 

This  conference  mi'II  include  discussion  and  information  related  to  the 
meeting  of  department  directors. 

The  participants  in  the  conference  are: 


I 


1 Smith  (Cnrmn)  not  on-lire  3 Brown  not  on-l 

2 Jones  .-ct  on-line  k Green  entering 

The  topics  in  the  agenda  ore: 

1 Budget  estimates 

2 Feedback  from  budget  estimates 

3 Oiscusiiors  of  new  projects  that  should  be  added  in  the  next  year. 

Agenda  topic  I 
Budget  estimates 

Activity  l.l 

Wnat  is  your  high  estimate  for  the  jra«nt  o!  f-nding  you  will  need  for 
project  operation*  this  year?  Answer  in  thousands  of  do'lars. 


hr 


We  would  like  you  to  forecast  our  tudgetary  r-eds  for  the  year  197b  (.r 
thousand-*  of  dollars),  uS'-'Q  a probabilistic  approach  to  determine  the 
range  of  forecast  and  median  value. 

Because  of  t*e  uncertainty  in  this  answer  we  would  lik»  to  establish  a 
range  of  possible  values.  First,  please  try  to  estimate  a value  so  low 
that  you  feel  th-re  is  only  one  chance  in  fen  that  the  actual  value  wi I 
turn  out  to  be  even  lower. 


how  try  to  estimate  a value  so  iiig.h  that  you  fe**'  there  is  only  one 
chance  in  ten  tr-at  the  actual  value  will  turn  out  to  he  even  higher. 


Using  y t,ur  high  a"J  low  e>timates,  we  can  -or.struct  t 
you  feel  there  jre  eight  ft.inc'-s  in  tc-  that  act*/ 
V_*  would  r.^w  li'-e  to  know  Y m thr»s«  chances  are  distr 
rang*.  M we  divided  th-  t.i-ge  »«•, 


'e  range  in  wh;ch 
* I v a 1 ue  will  tali 
f bated  through  th» 


and  you  had  to  wag«r  tha*  the  actui 
ore  of  the  two  Segments  rf  tn»  ubiv 
ch>sse?  Please  type  l for  tte  LEFT 
strike  only  the  CP  k»y  if  ynn  can't 


Figure  14.  Information  Elicitation  in  a FORUM  Conference 


7 • <Vf-.\T  (activity) 

Puts  you  into  the  next  activity  on  the  agenda.  For  example,  if  you  are 
in  activity  2 and  want  to  move  to  activity  3,  type: 

GLp  IforuTI)  kcrtll 

- InfxtI  (activity)|[CR)j 

8.  PREVIOUS  (activity) 

Returns  you  to  the  activity  preceding  your  current  one.  For  example, 
if  you  are  in  activity  2 and  want  to  return  to  activity  1,  type: 

Qto  |F:)HU!|EjJ  , 

- |pRKVTOUS|  (activity)  |[CR]| 

9 . J02.V  ( con  f e rone  a) 

Allows  you  to  move  from  one  conference  to  another.  If  you  would  like 
a list  of  available  conferences,  follow  the  "JOIN  (conference) " request 
wi til  a question  mark  [?]  . For  example: 


An  example  of  special  service  use  while  in  a discussion  is  shown  below: 

• [67]  HENRY  (CHRMN) 

- If  everyone  has  the  exact  proposal  in  front  of  him  (entries 

• - 42-^9,  I think),  perhaps  we  should  base  our  discussion  there 

- for  the  sake  of  prcc i s ion . [C R] 

• - [CR] 

• (to  FORUM)  [CR] 

- RFVIEW  (entries)  A2-49 [CR] 

• 

[42]  HENRY  (CHRMN)  FRI  21 -DEC-73  3:^8  PM 

• I am  now  finishing  a short  paper  describing  the  next  6 months  of  re- 
search with  FORUM.  I'll  be  getting  copies  of  this  to  all  of  you,  and 

• perhaps  vie  can  critique  it  in  this  conference.  OK? 


[43]  HENRY  (CHRMN)  MON  2*4-0(10-73  10 :45  AM 


■A 


Act i v i ty  2.3 

The  group's  aggregated  forecast  for  the  total  budget  ii  1976  will  be  fed 
back  in  graph  form  as  a probability  density  function  over  the  range  of 
forecast  budgets. 

Oisplay  of  probability  estimates  from  Activity  1.3 

We  would  like  you  to  forecast  our  budgetary  needs  for  the  year  1976  (in 
thousands  of  dollars),  using  a probabilistic  approach  tc  determine  the 
range  of  forecast  and  the  median  value. 


Figure  15-  Display  of  Probability  Estimates 
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FOKUM 1 s Upper  Level  Command  Mode 

To  leave  a discussion  activity  and  reach  FORUM's  full  command  mode,  strike 
the  Escape  or  ALTmode  key.  To  obtain  a list  of  available  coirmands,  strike 
the  question  mark  key  [?]  . For  your  convenience,  the  commands  aY-e  listed 
below.  Several  of  these  can  also  be  reached  as  special  FORUM  services  and 
are  described  there.  Note  that  while  special  services  allow  you  to  input 
commands  without  leaving  the  discussion  activity,  the  upper  level  command 
mode  prompts  you  with: 

COMMAND? 

* 

You  do  not  have  to  send  a private  message  to  FORUM;  rather,  simply  input  the 
command,  followed  by  one  carriage  return  [CR]  . 

1.  DESCRIBE 
See  page  75. 

2.  CONFERENCE  ( i n forma ti on ) 

Provides  you  with  any  background  information  submitted  by  the  chairman 
of  the  conference  in  which  you  are  participating. 

3.  AGENDA  (information) 

Provides  you  with  the  complete  agenda  for  the  conference  in  which  you 
are  par  ticipa ting - 

4 . ACTIVITY  (information) 

Provides  you  with  any  background  information  on  the  conference  activity 
in  which  you  are  participating. 

5.  STATUS  (of  participants) 

See  page  75 . 

6.  CONTINUE 

Returns  you  to  the  activity  in  which  you  were  participating  prior  to 
entering  command  mode. 

7 . GO  (to  activity) 

See  page  77. 

8.  NEXT  (activity) 


Sec.*  page  70. 
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9 .  PREVIOUS  ( tic  ti  vi  ty) 

See  page  79. 

1 0 . PR1 N T (transcript  for  activities)  , 

Provides  a transcript  of  the  activities  you  specify.  For  example: 

COMMAND? 

* IpRINT  | (transcript  for  activities)  [l,2 ,3  [CR]1 

11.  SAVE  (transcript  for  activities) 

Saves  the  responses  for  the  activities  you  specify  by  placing  them  in 
the  TENEX  file  you  name.  For  example: 


COMMAND? 

* 1SAVK  1( transcript  for  activities)  |all[CRJ| 


in  file 


MYFILE.TXT  [CRJ | (New  File) fc Rif 

1 


confirm  that  this  is  a 
Inew  file  by  typing  one 
{carriage  return  [CR] 


Note  that  MYFILE  is  the  name  given  to  the  file  for  this  example. 


1 2 .  MESSAGE  ( to  participants) 

Lets  you  send  a private 'message  to  anyone  registered  in  the  conference 
in  which  you  are  participating.  After  ycu  have  specified  the  name  of 
the  recipient,  strike  the  carriage  return  key  [CR]  once.  FORUM  will 
prompt  you  to  begin  typing  your  message.  To  end  the  entry,  strike  the 
carriage  return  key  [CR]  twice.  For  example: 


COMMAND? 


★ 

MESSAGE  kto  participants)  (SMITH  AND  LEE  [CR]1 

- 

There  will  bo  a meeting  at  4:00  mi  today.  [CR] 

- 

(CR]f~ 

1 3 .  RESTART 


Puts  you  at  the  beginning  of  the  conference  and  lets  you  begin  your  ac- 
tivities again. 


1 4 .  JOTS  (con Terence) 
See  page  79. 


1 'j . QUIT 


See  page  14  . 


i 
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D.  CHA I RICIAN  FUNCTIONS 

Release*  5 of  FORCJM  has  restrictions  placed  on  the  use  of  the  CHAIRMAN  pro- 
gram . The  CHAIRMAN  program  is  essentially  the  FORUM  program  with  additional 
commands  included  in  the  upper  level  command  mode.  These  additional  com- 
mands ore  concerned  with  the  creation,  modification,  and  monitoring  of  con- 
ferences. The  CHAIRMAN  program  will  be  modified  significantly  in  release  6 
of  FORUM. 


Entering  Chairman 

By  issuing  the  following  to  the  TENEX  executive,  you  may  run  the  CHAIRMAN 
program  and  have  all  the  chairman  capabilities  in  all  conferences  to  which 
you  have  access,  no  matter  whether  you  are  the  titular  chairman  or  have 
set  that  conference  up.  During  the  log-in  procedure,  issue  the  command: 

(^DIRECTORY  K AM£>Ctl AIRMAN  [CR]} 


Creating  a Conference 

At  any  paint  after  logging  in  and  selecting  a conference,  you  may  go  into 
the  upper-level  command  mode  by  striking  the  ESCape  or  ALTmode  key.  Upon 
receiving  the  "COMMAND?"  prompt,  issue  the  "SETUP  conference"  command.  For 
example : 

COMMAND? 

* JsE,f. Up)  (conference) 

This  will  call  the  SETUP  program,  a sequential  process  that  must  not  be  in- 
terrupted once  it  is  begun.  If  errors  are  made  during  the  process,  they 
should  be  corrected  after  the  conference  is  completed,  using  the  modifica- 
tion commands  described  later. 

j.  Entering  Homes  of  Participants 

The  program  will  prompt  you  with: 


Please  enter  the  last  names  of  the  participants: 

Participant  # 1 (CHRMN) : 

At  this  point,  type?  the  last  name  of  the  person  who  is  to  act  as  chair- 
man, followed  by  one  carriage  return  ICR]  . You  will  then  be  prompted 
for  the  name  of  the  second  participant.  You  may  continue  to  add  names 
and  will  be  prompted  similarly  each  time.  To  indicate  that  no  more 
participants  are  to  b_*  included,  strike  the  carriage  return  key  [CR] 
once  v.*hen  you  are  prompted  for  a name.  For  example: 


A 


ou  are  currently  not  in  any  conference  and  are  now  free  to  work  in  the 
command  mode.  Please  type  ? if  you  wish  a list  of  your  available  commands. 

Command? 

*setup  (conference) 

Please  enter  the  last  names  of  the  participants: 

Participant  8\  (Chrmn):  Smith 

Participant  #2:  Jones 

Participant  #3:  Brown 

Participant  ft!i : Green 

Participant  fi 5: 

Do  you  wish  to  allow  guests? 

- n 

Please  type  a one-line  descriptive  title  for  the  conference. 

“ System  Design  Conference 

Do  you  wish  to  provide  the  participants  with  background  informs  Ton  on  the 
conference  as  a whole? 

* y 

Please  enter  the  background  information. 

- This  conference  consists  of  one  discussion  activity,  to  which  the 

- CHAIRMAN  may  add  more  activities  later  or  keep  as  it  is. 


is 


kv 


Do  you  wish  to  create  an  outline  of  topics  which  will  be  used  as  on  agenda? 


Figure  16.  Setting  Up  a FOrUJM  Conference 
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Ploase  enter  the  last  r ames  of  the 
Participant  # 1 (CHRMN)  : 

Participant  # 2: 

Participant  # 3: 

Participant  # 4: 

Participant  # 5: 

2.  Privacy  of  Conference 
You  will  then  be  prompted  with: 

Do  you  wish  to  allow  gu» 

- InIcriI 

By  typing  "N"  (signifying  "No  / , you  have  restricted  conference  attend- 
ance only  to  those  participants  you  have  explicitly  named  in  step  1, 
or  those  inserted  into  the  participant  list  using  the  "INSERT  PARTICI- 
PANT" command  (see  page  93) . By  typing  "Y"  (signifying  "YES")  , any 
user  of  the  FORUM  program  may  attend  this  conference  and,  if  electing 
to  do  so,  will  be  entered  into  the  participant  list  by  FORUM  itself. 

3.  Title  of  the  Conference 


Lee  [CR]| 


Smith  [CR] 


Jones  [CR] 


Brown  [CR] 


You  will  next  be  prompted  with: 

Please  type  a one-line  descriptive  title  for  the  conference. 

- [Demonstration  of  the  CHAIRMAN  program  [CR]| 

This  title  may  be  longer  than  one  line,  but  only  the  first  line  will  be 
shown  to  participants  when  they  are  asked  which  conference  they  wish  to 
attend.  The  title  is  ended  by  typing  one  carriage  return  [CR] . 

4.  Background  Information  on  Conference 

You  will  tl.^n  be  prompted  with' ; 

Do  you  wish  to  provide  the  participants  with  background  information 
on  the  conference  as  a whole: 

- U [CR]  | 

The  "YES"  response  will  then  cause  the  program  to  ask: 


Please  enter  the  background  information. 


f3 


|This  is  a conference  set  up  solely  for  the  purpose  of  demonstra- 
tion. It  should  show  the  new  chairman  the  means  he  has  at  his 
disposal  by  which  he  can  create  a conference.  [CRjf 
[CR]' 


The  background  information  for  the  conference  will  be  printed  out  to 
the  xarticipant's  terminal  after  the  title  is  printed.  This  allows  the 
chairman  to  offer  prefatory  remarks  cn  the  purpose  of  the  conference, 
etc . 


Please  enter  agenda  topic  1 

- Discussion  of  new  program  protocol 

Please  enter  agenda  topic  2 T Note:  Only  one  agenda  Item  created.  C R 

- « ■ — L heAe  to  6 top  agenda  cAeatlon . 

Do  you  wish  to  include  subtopics  in  the  agenda? 

- n 

Do  you  wish  to  provide  background  information  on  specific  agenda  topics? 

- n 

Please  enter  the  instructions  and  response  formats  for  the  specific 
activities  to  be  performed  under  each  topic  and/or  subtopic  during  the 
conference. 

1 Discussion  of  new  program  protocol 

Please  enter  the  instructions  for  activity  1.1 

- Discussion  and  notepad... 

Response  format?  discussion 
Response  format? 

Please  enrer  the  instructions  for  activity  1.2 

Do  you  wish  to  provide  background  information  on  any  of  these  activities? 


Command? 
* res  tart 


SETUP  complete  at  tkti  point . Chairman  liiuei  £ 
"RESTART”  command  to  participant  In  conference  ^ 
and  check  {or  evto-U  (suggested  practice) . jti 


i 


I 


Figure  17-  Setting  Up  a Conference  Agenda 
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lf  you  respond  "NO"  to  the  initial  prompt,  the  program  will  go  on  to 
step  5. 

5.  Croatia n of  the  Conference  Structure 
a.  Next,  you  will  be  prompted: 

Do  you  wish  to  create  an  outline  of  topics  which  will  be  used 

as  an.  agenda  during  the  conference? 

- iv  ieiiil 

It  is  not  mandatory  that  you  create  the  outline  structure.  You 
can  elect  to  create  only  activity  items  that  will  be  structured 
sequentially  and  with  integer  item  numbers.  By  specifying  "YES'’, 
you  provivu  the  participant  with  a division  cf  the  conference 
which  will  be  printed  out  when  he  enters  the  conference.  If  "NO" 
is  specified,  the  program  will  go  to  step  6.  In  the  example,  the 
chairman  has  elected  to  create  an  outline. 

Please  enuer  one-line  descriptions  of  the  main  agenda  topics. 

Please  enter  agenda  espial 

- [Demons tratior.  of  the  discussion  activity [Cftll 

Piase  enter  . genda  topic  2 

- [Demonstration  of  other  information  elicitation  activities [CR]| 

Please  enter  agenda  topic  3 

- EckU 


By  typing  one  carriage  return  [CR]  , the  chairman  signifies  that 
there  are  no  more  main  divisions  to  be  made.  This  structure  can 
be  modified  later  using  the  "INSERT  ACTIVITY"  command  (see  page  94). 

b.  At  this  point,  the  demonstration  conference  contains  only  two 

agenda  items,  or  divisions,  and  no  activities  such  as  discussions 
or  number  elicitations.  The  agenda  items  can  he  considered  only 
as  "placeholders"  or  labcleu  dividers.  ¥ou  will  cher.  be  prompted 
with : 


Do  you  wish  to  include  subtopics  in  the  agenda? 

-mm 


This  gives  the  chairman  the  opportunity  to  further  subdivide  the 
conference  by  dividing  the  main  agenda  items  into  subtopics.  If 
"NO"  is  specified,  the  program  goes  to  step  G. 

Please  enter  the  numbers  of  the  agenda  topics  for  which  you 
wish  tc  include  subtopics.  If  you  do  not  wish  to  include  more 
subtopics  strike  o’  iy  the  CR  key. 

ffdMo 

Please  enter  one -line  der.cr;  ptions  o£  the  man  agenda  topics. 
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type  a coe-lfne  descriptive  title  for  the  conference. 

- Department  Directors  Meeting 

Do  you  wish  to  provide  the  participants  with  background  information  on 
the  conference  as  a whole? 


Please  enter  the  background  information. 

* This  conference  will  include  discussion  activities  and  other  Information 
- elicitation  activities  for  a hypothetical  meeting  of  department 
1 rectors. 

Do  you  wish  to  create  an  outline  of  topics  which  will  be  used  as  an 
agenda  during  the  conference? 


Please  enter  one-line  descriptions  of  the  main  agenda  topics. 

Please  enter  agenda  topic  I 
- Budget  estimates 

Please  enter  agenda  topic  2 
■ Fee'b«ck  from  budget  estimates 


ase  enter  the  instructions  «-nd  r-'.porse  formats  for  the  specific 
activities  to  be  performed  under  each  topic  and/or  subtop’C  during  the 
conference. 

I Budget  estimates 

Please  enter  the  instructions  for  activity  l.l 

■ What  is  your  high  estima--  for  the  amount  of  funding  you  will  need  for 
- project  operations  this  year?  Answer  ir  thousand',  of  dollars. 


Pesponse  for-»t?  number 
Response  for  at? 

Please  enter  the  instructions  for  activity  i 

* What  is  your  low  estimate  for  th»  amount  of  tunding  you  will  need  this 

* year?  Answer  in  th>u*  sn<J>  of  dollars , 

Pesponse  format?  rubber 
Pesponse  forms'? 

Please  .inter  the  in.t'uCtions  for  activity  1.3 

- We  would  like  you  to  forecast  0^ r budgetary  needs  for  1976  (in  thousands 

- of  dollars),  using  a pro_Ju> f i* l lc  approach  to  determine  the  range  of 

- forecast  and  th  ■ median  value. 


P.espons*  format'  probability 
Please  indicate  tse  raairu-m  vi 


lc”.cw t cl  nir.irurt  wifi.-  <1  <U4: tr*d  t ' fe«  .S’V. 


Figure  18.  Setting  Up  Activities  withii.  an  Agenda 
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Please  enter  agenda  topic  1 . 

- frhe  first  discussion  [Ckl| 
Please  enter  agenda  topic  .! . 2 

- K'he  second  discussion  [C R]  | 
Please  enter  agenda  topic  1.3 

- lfcRil 


Please  enter  che  numbers  of  the  agenda  topics  for  which  you 
wish  to  include  subtopics.  If  you  do  not  wish  to  include  more 
subtopics,  strike  only  the  CR  key. 


In  the  preceding  example,  the  chairman  has  elected  to  subdivide 
agenda  item  1 into  two  subtopics.  (He  specified  that  he  did  not 
want  an  item  1.3  by  typing  one  carriage  return  [CR]  .)  The  program 
then  prompted  him  to  determine  if  an"  ''ther  agenda  item  was  to  be 
subdivided.  At  this  point,  the  chai-rcan  could  have  subdivided 
agenda  item  2 or  either  of  the  subtopics  created  above  (i.e  - item 

1.1  or  1.2).  Instead,  the  chairman  elected  to  make  no  mor  \bdi- 
visions.  Thus,  the  sample  conference  structure  now  consist,  of 
the  following  agenda  items  c activity  items.  (The  following 

message  will  be  printed  on  ai  ing  participant's  terminal.) 


The  topics  in  the  agenda  are: 


1 Demonstration  of  the  discussion  activity 

1.1  The  first  discussion 

1.7  The  second  discussion 

2 Demonstration  of  other  information-elicitation  activities 


c.  You  will  then  be  prompted: 


Do  you  wish  to  provide  background  information  on  specific 
agenda  topics? 


- fc[CK~)| 


If  "YDS"  is  specified,  the  program  will  ask  for  the  agenda  item  num- 
ber to  which  you  wish  to  supply  background  information  and  then  ask 
for  the  text.  It  will  keep  asking  for  agenda  item  numbers  unf*  1 you 
type  one  carriage  return  [CR] , signifying  no  more  background  infor- 
mation is  to  be  placed  into  agenda  items. 


5.  Crea  : on  of  Activity  I tarns 


At  this  point  in  the  process,  you  will  be  prompted: 

Please  enter  the  instructions  anc  response  formats  for  the  specific 
activities  to  be  performed  under  each  topic  and/or  subtopic  during 
the  conference. 

1 Demonstration  of  the  discussion  activity 

1.1  The  first  discussion 


i 
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Please  enter  the  instructions  for  activity  1,1.1 


This  is  the  first  discussion  of  this  conference.  I have  sub- I 


divided  the  first  main  topic  heading  for  demonstration  pur 
poses.  CCRir 
[CR]’ 


Response  format?  [DISCUSSION [CR] j 
Response  format?  [[CR]] 


Notice  that  the  program  prints  the  conference  outline  structure  and 
then  prompts  for  the  instructions  of  the  first  activity,  which  is  a 
subdivision  of  the  lowest  agenda  item  (in  this  case  item  1.1).  The 
"Response  format?"  prompt  asks  the  chairman  what  sort  of  information 
will  be  elicited  in  this  activity.  The  options  are: 

1)  "DISCUSSION" 

2)  "ESSAY" 

3)  "NUMBER" 

4)  "PROBABILITY" 

5)  A feedback  option,  "SUMMARY  (results  from  activity)  [ACTIVITY 
ITEM  #]" 

To  clarify  the  procedure  and  the  various  response  formats,  the  rest  of 
the  "SETUP  conference"  process  for  the  demonstration  conf„j.ence  is  shown 
below: 

Please  enter  the  instructions  for  activity  1.1.2 
- OcrTI  (indicating  no  further  activities  under  agenda  item  1.1) 

1.2  The  second  discussion 

Please  enter  the  instructions  for  activitv  1.2.1 


dF| 

>ation| 


This  is  the  second  discussion.  By  setting  up  a series  of] 
discussions,  a chairmdn  may  divide  the  topics  of  conversation! 
or  provide  separate  meeting  rooms  for  subgroups  in  the  I 
conference.  [CP.lf" 

[cr]  r 


Response  format?  IpIUCUSCION  [CR]] 
Response  format?  |lCR]| 


Please  enter  the  instructions  for  activity  1.2.2 
- [tCRjI 


2 Demonstration  of  other  information  elicitation  activities 
Please  enter  the  instructions  for  activity  2.1 


This  is  an  example  o£  the  numerical-information  elicitationj 
c t ivity.  I might  ask,  "What  is  the  sum  of  6 + 5?"[CUj[ 


[CP] 
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Response  to r m a t ? ) NUM3L-I R [C rT] 

Response  format?  |[CRj| 

Please  enter  the  instructions  for  activity  2.2 


This  is  the  "ESSAY"  format.  1 might  want  a short  answer  which 
will  ROT  be  distributed  to  the  other  participants  in  this 


discussion  until  I wish  the  program  to  display  the  answers, 

The  question  I might  ask  is,  "Please  Trite  a short  positionj 

paper  giving  your  stance  on  the  proposed  school  bond  election [CR]1 
[CR][ 


ter  which) 
;.his  | 1 

;wers7] 
>ition| 


Response  format?  [ US SAY  [CR1[ 

Response  format?  | [CR j[ 

Please  enter  the  instructions  for  activity  2.3 

- This  is  a demonstration  of  the  probability-elicitation  format 

- which  goes  through  an  iterative  procedure  to  obtain  estimates 

- of  some  numerical  value,  but  which  are  uncertain  for  the! 

- respondent.  For  example,  I might  ask,  "Please  estimate  the) 

- distance  between  San  Jose_and  San  Francisco,  California  (inj 

- miles)  ."  [CrJ 

- icp.ir 

Response  format?  fpRObAatLlTY [CR]  I 

P lease  indicate  the  maximum  value  of  the  variable, 
ft  fjQQ[CK]l 

Response  format?  |[CR  J 1 


Please  enter  the  instructions  for  activity  2.4 


This  will  demonstrate  the  feedback  mechanisms  to  which  you  have 
" $ U MMARY  results"  ot  a discussion  will  print  the  fullj 


access 
transcript.  [CR jf" 
ICRjl ' 


1 


Response  format? 

SUMMARY 

(results  from  activity) 

2.1 [CR] 

Response  format? 

SUMMARY 

(results  from  activity) 

2.2  [CR] 

Response  format? 

SUMMARY 

(results  from  activity) 

2 . 3 [CR] 

Response  format? 


Please  enter  the  instructions  for  activity  2.5 
- | [CR]]  indicates  that  there  are  no  more 

activity  items  under  agenda  item  2 


The  "SETUP  conference"  procedure  will  then  ask  for  background  informa- 
tion since  there  are  no  morn  agenda  items  under  which  to  place  activity 

i terns . 


Do  you  wish  to  provide  background  information  on  any  of  these 
ac ti\ i ties? 

COMMAND? 
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The  process  is  now  complete,  and  the  chairman  has  been  returned  to  the 
upper-level  conuuand  mode. 


E.  CHAIRMAN  UPPER-LEVEL  COMMAND  MODE 

At  any  point  in  the  CHAIRMAN  procram  (except  during  the  "SETUP  conference" 
procedure) , the  user  may  reach  the  full  command  mode  by  striking  the  ESCape 
or  ALTmode  key.  To  obtain  a list  of  available  commands,  strike  the  ques- 
tion mark  key  [?].  For  your  convenience,  the  commands  to  which  the  CHAIR- 
MAN program  has  access  are  listed  below.  In  addition  to  these  commands, 
the  CHAIRMAN  program  has  access  to  all  of  the  commands  of  the  FORUM  program. 
The  upper  level  command  mode  prompts  you  with: 

COMMAND? 

* 

You  may  then  type  the  command,  followed  by  one  carriage  return  [CR] . 

1 • CLOSE  ( discussion  at  activity)  [ACTIVITY  ITEM  ft] 

(for  participants)  [P.WTICIPANT  NAMES  or  "/XL"] 

Will  prevent  a participant  who  is  not  using  the  CHAIRMAN  program  from 
entering  or  reviewing  an  activity  with  the  "DISCUSSION"  format.  For 
example,  if  the  chairman  gives  the  following  command: 

COMMAND? 

* IcLOSeI  (discussion  at  activity)  |l.  1. 3 (Cpfl 
(for  participants)  1all(CR]| 

all  participants  except  those  using  CHAIRMAN  will  receive  the  message: 
Activity  1.1.1 

This  is  the  first  discussion  of  this  conference.  I have  subdivided 
the  first  main  topic  heading  for  demonstration  purposes. 

The  discussion  on  this  subject  is  now  closed. 

and  will  be  transferred  to  the  next  item  automatically. 

2.  OPEN  (discussion  at  activity)  [ACTIVITY  ITEM  V] 

(for  i^articipants)  [PARTICIPANT  NAVES  or  "ALL"] 

Will  reactivate  a discussion  for  those  participants  d*' ~ignated  after  the 
"CL03E  (discussion  at  activity)"  command  has  been  given.  Note  that  when 
a discussion  activity  is  created  in  the  "SETUP  conference"  process,  the 
default  is  that  the  discussion  is  open  to  all  participants. 
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3 . DELETE  (activity)  [ACTIVIT Y ITEM  ft] 

(for  part ici pants)  [PARTICIPANT  NAMES  or  "ALL"] 

Will  delete  the  activity  from  all  the  designated  agendas.  The  FORUM  and 
CHAIRMAN  programs  will  not  know  of  the  existence  of  the  designated  ac- 
tivity or  agenda  item. 

4.  UNDELETE  (activity)  (ACTIVITY  ITEM  H] 

(for  participants)  [PARTICIPANT  NAMES  or  'ALL"] 

Will  reinsi  . me  item  designated  in  the  agendas  of  the  participants 
named  after  the  "UNDELETE  (activity)"  command  is  given. 

5.  FEEDBACK  (SUBCOMMAND] 

This  will  allow  you  to  have  the  summary  results  of  an  activity  printed 
to  your  terminal,  if  you  type: 

COMMAND? 

* [FEEDBACK  PRItrrj  (summary  results  from  activity)  [[ACTIVITY  ITEM  #j  [CR]  | 

Or,  it  will  allow  you  to  have  the  summary  results  fed  back  to  ail  partici- 
pants in  an  existing  activity,  if  you  type: 

COMMAND? 

* [feedback  summary"!  (results  from  activity)  ([ACTIVITY  ITEM  #]  [CR] 
(under/at  activity)  [[ACTIVITY  ITEM  #J  [CrT| 

This  second  option  does  the  same  thing  as  specifying: 

Response  format?  SUMMARY  (results  from  activity)  [ACTIVITY  ITEM  #] 

in  the  "SETUP  conference"  process. 

6 . SETUP  ( conference) 

See  the  section  entitled  "Creation  :£  the  Conference  Structure"  on  page  87. 

7.  INSERT  ( SUBCOMMAND] 


The  optional  subcommands  are  listed  below. 

a . INSERT  BACKGROUND  (for  i tom)  [ITEM  ft] 

Will  ask  for  the  item  number  and  then  prompt  for  the  background  text. 

b.  INSERT  PAHTICIPA NT [ CR / 


Will  give  you  the  next  free  participant  number  and  ask  for  his/her 
last  name.  For  example: 


I 
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COMMAND? 

* 1 INSERT  PARTICIPANT  [C8j| 

Participant  # 5:  [[NAME]  [CR]| 

If  you  wish  to  change  the  name  of  a participant  already  specified, 
type  the  participant  name  rather  than  a carriage  return.  For  example, 
for  the  sample  conference: 

COMMAND? 

* [insert  participant  miller [crTI 
will  cause  the  program  to  prompt: 

Participant  # 1 (CURMN)  : [[NEW  NAME]  [CR]  1 

C.  INSERT  AGENDA  (topic)  [AGENDA  ITEM  # ] 

Will  allow  you  to  add  a new  agenda  item  with  the  number  specified 
ana  ask  for  the  one-line  descriptive  title,  or,  if  you  specify  an 
already  existing  agenda  item,  it  will  allow  you  to  replace  the 
text  of  the  one-line  title  for  that  item. 

d . INSERT  ACTIVITY  [ ACTIVITY  ITEM  fjj_ 

Wil3  allow  you  to  add  a new  activity  item,  will  prompt  you  for  the 
text  and  the  response  format,  or  will  allow  you  to  replace  an  al- 
ready existing  activity  with  a new  set  of  instructions  and  response 
format. 

8 . ASSIGN  ( activity  schedules  for  participants)  [PARTICIPANT  NAMES  or  " ALL ”7 


When  you  insert  a new  agenda  or  activity  item  (i.e.,  add  a new  item  num- 
ber to  the  agenda) , you  have  only  altered  a master  agenda  but  not  the 
agendas  of  individual  participants.  For  new  items  to  be  added  to  the 
sequence  of  events  of  participants,  you  must  assign  new  activity  sched- 
ules for  those  to  whom  the  changes  made  by  insertion  should  apply. 


i 

l 
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APPENDIX  2:  PROGRAM  ORGANIZATION  AND  PERFORMANCE 


A.  GENERAL  STRUCTURE 

This  section  deals  with  the  performance  of  the  operational  version 
(FORUM-5)  and  with  the  file  structure  of  the  advanced  prototype  (FORUM-6)  of 
a medium  of  interpersonal  communication/  which  may  operate  in  real  time  or, 
by  means  of  message  storage,  as  a delayed  message-distribution  system.  Like 
earlier  versions,  FORUM-6  functions  as  an  information-elicitation  device 
which  administers  online  questionnaires,  processes  the  answers,  and,  under 
the  control  of  the  activity  organizer,  feeds  back  the  participants’  answers. 
The  third  function  of  FORUM  is  that  of  a limited  information  storage  and 
retrieval  system.  The  data  base  maj  include  conversations  held  using  this 
medium,  questionnaire  data,  or  personal  data  bases  such  as  bibliographies, 
note  pads,  and  so  forth.  The  overall  organization  of  the  system  is 
shown  in  Figure  19.  As  can  be  seen,  an  activity  has  a title  and  contents , 
possibly  br  ken  into  parts  that  may  represent  a complete  tree  structure. 

The  smallest  unit  of  information  accessible  to  the  user  is  an  entry.  An 
entry  has  a number,  an  author  name  (possibly  "Anonymous") , a date/time  stamp, 
and  text. 

In  the  advanced  prototype  version  there  are  two  participant  roles, 
organizer  and  participant.  The  program  structure  is  accordingly  based  on 
levels  of  access  to  an  activity:  the  ORGANIZER  program  will  have  total  con- 

trol over  participant  roles  and  text.  Participants  run  the  USER  program 
that  can  be  placed  in  corrector  mode  by  hitting  the  ESCaoe  or  ALTmode  key. 

Formally  described,  the  FORUM  USER  program  can  be  represented  as  a 
finite-state  machine.  Figure  20  is  a simplified  dic-gram  of  the  ten  states 
or  modes  into  which  the  FORUM  program  can  currently  bo  placed.  These  are 
as  follows: 


I 

Figure  19.  General  Concepts  for  an  Advanced  Version  of  FORUM 
I * Mot  implemented  in  Release  6 
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= idle  mode 

= feedback  questionnaire  (restricted  format,  single  recipient) 

= asynchronous  directed  (one  user,  specific  topic) 
s^  = asynchronous  free 

s4  = synchronous  directed  (specific  topic,  simultaneous  discussion) 

- synchronous  free 
s = private  message  mode 

D 

~ anonymous  mode 

S0  — "whisper"  to  FORUM 
o 

sg  = "whisper"  to  EXEC 

In  the  idle  mode,  participants  can  review  their  own  private-message  file, 
send  private  mes ScV-rj  to  others,  and  display  activity  status.  The  feedback- 
questionnaire  sta  ■ rresponds  to  the  administration  by  FORUM  of  a list  of 
pre-specif ied  questions.  The  asynchronous  states  are  those  in  which  the  par- 
ticipant is  the  only  user  of  a given  conference  by  contrast  with  the  syn- 
chronous states  in  which  others  are  involved  in  real  time.  In  the  "whisper" 
moaes  communication  is  not  with  other  human  participants  but  v/ith  systems. 

To  illustrate  this  process,  let  us  take  the  example  of  a user  who  is 
engaged  in  a free  synchronous  discussion  mode  (state  s^) . Here  any  partici- 
pant can  send  a message  to  any  other  with  no  topical  restriction.  Let  us 
assume  that  he  now  types  a left  parenthesis  as  the  first  character  of  an  en- 
try and  follows  it  with  the  full  command: 

(to  FORUM)  REVIEW  ALL 

The  single  parenthesis  would  be  recognized  as  an  input  that  triggers  the 

transition  to  another  state,  in  this  case  state  s.,  (private  message  mode) , 

o 

where  the  recipient  is  a subgroup.  The  name  of  the  lesipient,  however,  is 
FORUM  itself,  which  results  in  another  transition,  this  time  to  die  sLctLe 
3 , where  the  recipient  is  the  system  arl  where  the  format  is  that  of  a com- 

o 

raand  that  must  tollow  the  FORUM  syntax. 


t 
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We  will  see  below  how  the  seine  example  will  be  processed  by  the  vari- 
ous modules  in  the  release  6 program. 

Although  this  formal  description  of  FORUM  is  highly  simplified,  it  does 
convey  one  important  point:  in  future  as  well  as  in  current  versions,  the 

participant  in  a FORUM  discussion  has  control  over  a wide  range  of  operation 
modes,  and  the  transitions  between  these  modes  involve  the  range  of  partici- 
pation, the  nature  of  the  topics,  the  format,  and  other  parameters. 

The  simplified  state  diagram  of  Figure  20  shows  that  the  FOP.'JM  concept 
allows  direct  transitions  between  asynchronous  and  synchronous  usage  and 
never  "locks"  the  user  rnside  a particular  mode,  except  in  the  special  case 
of  a questionnaire  with  feedback,  where  the  user  environment  is  purposely 
constrained. 

The  next  two  sections  will  describe  how  these  functions  are  actually 
accomplished  and  what  specific  problems  have  been  encountered. 


B.  PROGRAM  MODULES 

The  various  programs  that  correspond  to  the  operation  modes  of  FORUM 
are  written  entirely  in  assembly  language  and  run  under  the  TENEX  timeshar- 
ing system  on  PDP-10  computers.  (Mote:  A version  of  FORUM-5  running  'inder 

the  TOPTS-10  operating  system  is  currently  being  implemented  by  the  Insti- 
tute for  the  Future.)  There  were  several  considerations  that  led  to  the 
choice  of  assembly  language  rather  than  a higher-level  language  (such  as 
FORTRAN  or  PL-1) . First,  the  available  higher-level  languages  have  been 
written  for  specific  purposes  that  do  not  include  remote  conferencing. 

Thus,  if  we  had  chosen  a higher-level  language,  we  could  have  obtained  a 
working  program  faster,  but  in  the  long  run,  we  might  have  been  constrained 
by  the  language  its. If  and  been  severely  limited  in  our  efforts  to  imple- 
ment the  basic  components  of  this  teleconferencing  medium  at  the  level  of 
detail  that  we  required.  The  ability  to  control  both  input  from  the  user 
and  output  to  him  was  a basic  need:  features  such  as  editing  capability 

and  paging  for  CRT  terminals  requite  a detailed  control  of  thp  input/output 
rronitor  calls.  The  rest  important  consideration  in  selecting  an  implementa- 
tion language  was  that  teleconferencing  by  computer  involves  communication 
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be tween  parallel  running  jobs.  The  only  practical  way  to  achieve  this  is 
through  shared  files.  Since  the  conventional  file  machinery  of  most  sys- 
tems is  geared  to  the  one  user/one  file  concept,  we  were  forced  to  bypass 
the  available  high-level  mechanisms  and  build  our  own  file-access  system 
using  the  primitive  monitor  calls.  At  this  writing,  FORUM  is  the  only  con- 
ferencing system  in  existence  that  uses  files  that  are  shared  in  real  time. 
This  file-access  system  is  explained  further  in  Section  C. 

Assembly  language  also  allows  more  efficient  use  of  computer  resources 
than  do  most  higher-level  languages.  FORUM  is  completely  reentrant  so  that 
not  only  participants  in  the  same  activity  but  also  those  in  other  activi- 
ties use  the  same  copy  of  the  program.  Moreover,  FORUM  is  almost  entirely 
input/output-oriented,  or  "I/O-bound".  The  implementation  of  the  FORUM  pro- 
gram in  assembly  language  has  allowed  an  efficient  connect  time  to  CPU  time 
ratio,  providing  a low  usage-demand  on  the  host  computer  while  giving  good 
user/computer  response  times  under  heavy  machine  loads.  As  will  be  seen  in 
Section  D,  where  the  results  of  an  analysis  effort  are  reported,  FORUM  typi- 
cally uses  one  minute  of  PDP-10  computer  time  for  every  two  hours  of  confer- 
encing (per  participant)  . Similar  performance  figures  are  expected  under 
FORUM -6. 

The  FORUM-6  program  is  designed  to  run  on  a standard  time-sharing  sys- 
tem as  a user  program  or  eventually  as  a subsystem  of  the  operating  system 
itself.  It  consists  of  approximately  140  separate  assembly -language  subrou- 
tines whi^h  make  up  its  executive  program,  five  subsystems,  and  three  util- 
ity libraries.  The  subroutines  communicate  with  one  another  by  means  of  the 
PDP-10 ' s twenty  accumulators,  the  shared  files  described  later,  a hardware- 
implemented  pushdown  stack  indexed  by  accumulator  17  (reserved  for  this  pur- 
pose) , and  the  private  menory  space  allocated  to  the  job  running  the  FORUM 
program.  Certain  locations  in  the  memory  space  are  given  labels  recognized 
by  more  than  one  subroutine  so  that  these  locations  can  also  be  used  for 
passing  arguments. 

FORUM's  executive  subroutine  (box  #1  in  Figure  22)  is  the  first  to  be- 
gin execution  when  a participant  enters.  Its  main  purpose  is  to  direct  the 
participant  to  the  activity  he  wishes  to  join,  as  well  as  to  initialize  the 
paging  control,  terminal  control  features,  pseudo -interrupt  system,  and  the 
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Figure  21 . 


Overa 


Organization  of  the  FORUM-6  Program 


file  system.  Once  the  participant  has  decided  which  activity  he  wishes  to 
join,  FORUM  transfers  control  to  the  appropriate  subroutines. 

This  module  handles  the  request  for  user  name  and  password,  the  user 
recognition,  and  the  terminal  being  used;  it  prompts  the  participant;  for 
the  number  of  the  activity  he  wishes  to  join.  The  same  module  also  handles 
the  leaving  procedure  and  asks  the  participant  whether  or  not  he  wants  to 
join  a different  activity. 

There  are  five  subsystem  libraries  in  FORUM.  These  elicit,  process, 
and  transfer  information  among  the  participants.  The  utilities  libraries 
provide  the  functions  that  are  necessary  for  the  five  subsystems  to  communi- 
cate with  the  participants.  These  are  the  boxes  numbered  7,  8,  and  9 in 
Figure  21. 

When  the  participant  has  been  recognized  by  ■ dule  #1,  control  is  trans- 
ferred into  one  of  the  five  subsystem  libraries  based  on  information  in  the 
control  file  created  by  the  organizer.  Generally  this  will  be  to  module  #3 
(discussion)  where  the  interactive  routine  is  stored.  PROGRAM  CONTROL  (#9) 
contains  most  of  the  command  routines.  Some  specialized  commands,  however, 
reside  in  CREATE  AND  MODIFY  arid  others  that  deal  wi th  private  messages  are 
processed  in  module  #5,  but  Lhe  main  command  reader  is  in  module  #9  which 
sends  the  user  back  to  whatever  program  is  required. 

Module  #1  is  used  for  getting  the  name  and  password  and  joinino 
or  leaving  conferences.  When  a user  leaves  one  conference  to 
join  another,  he  is  actually  sent  back  to  this  module,  as  if  he 
started  again.  That  mor.ule  contains  the  routines  for  resetting 
the  status  when  a user  comes  into  a discussion.  This  library 
also  contains  most  of  the  subroutines  that  perform  routine 
checking  operations. 

Module  #2,  CREATE  AND  MODIFY,  is  concerned  with  the  main  orga- 
nizer actions,  its  main  command  is  the  "CREATE/activity”  com- 
mand which  guides  the  organizer  and  translates  his  instruc- 
tions into  a schedule  of  computer  instructions  that  the  parti- 
cipant programs  will  follow.  The  subsystem  also  provides  com- 
mands to  modify  an  existing  activity  once  it  has  been  created. 

Module  #3,  DISCUSSION,  handles  the  elicit. atior.  process  given  a 
pre-specified  information  format  (e.g.,  number,  probability, 
essay,  or  vote) . it  provides  the  storage  function  appropriate 
to  each  data  type.  This  subsystem  for  processing  information 
also  contains  the  subroutines  used  for  processing  arid  printing 
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*-ext  entries  either  by  command  from  a participant  or  under  pro- 
gram control.  There  are  four  basic  types  of  processing:  tex- 

tual, votes,  single  numerical  estimates,  and  probability  esti- 
mates. The  type  of  processing  is  chosen  automatically  by  the 
nature  of  the  information  being  processed.  * 

Module  #4,  REVIEW  AND  FEEDBACK,  provides  the  processing  of  the 
files  in  response  to  user  commands  that  require  the  reorgani  za- 
tion  and  display  of  previously  stored  data. 

Module  #5,  PRIVATE  MESSAGES,  handles  all  the  nonpublic  communi- 
cation functions. 

Module  #6,  STATUS  AND  DESCRIPTION,  processes  the  request  for 
status  of  participants  when  called  by  module  #9.  If  a new  user 
comes  into  a discussion,  this  information  is  reflected  in  the 
file  and  is  processed  and  reported  by  module  #3.  There  are  ac- 
tually three  places  where  a person's  status  is  reflected:  (1) 

in  the  global  file  that  keeps  track  of  whether  a person  is  on- 
line and  what  activity  he's  in;  (2)  the  control  file  indicates 
which  part  the  user  is  executing;  and  finally  (3)  the  part  in- 
formation indicates  who  is  typing. 

Module  #7  is  the  FILE-REFERENCING  utility.  It  contains  subrou- 
tines for  storing  and  retrieving  data  from  the  set  of  three 
shared  files  used  for  each  activity.  These  subroutines  ensure 
that  participants  can  both  simultaneously  and  instantaneously 
read  and  write  entries  in  these  files. 

Module  #3  performs  the  pagination  operation  that  is  required  on 
output.  All  of  the  terminal  input/output  operations  are  han- 
dled by  this  utility  library.  It  includes  subroutines  for  edit- 
ing text,  printing,  and  performing  special  functions  for  CRT 
terminals. 

E^ery  routine  references  module  #7,  so  there  is  horizontal  as  well  as 
vertical  communication  in  the  diagram  of  Figure  21. 

The  following  exam£)le  might  illustrate  the  actual  flow  of  control  in 
release  6.  Assume  that  a user  is  in  a discussion  activity.  This  input  is 
being  processed  by  module  #3  until  he  types  a left  parenthesis.  Let  us  con  - 
sider  the  case  when  he  types  the  command: 


(to  FORUM)  REVIEW  ALL 


At  that  point,  control  is  transferred  to  module  #5,  since  the  left  paren- 
thesis as  the  first  character  of  an  entry  indicates  a private  message. 
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Module  #5  will  acquire  the  name  of  tne  intended  recipient.  In  this 
case,  it  recognizes  the  name  FORUM  and  relinquishes  control  to  module  #9, 
which  reads  the  command  "REVIEW".  This  triggers  module  #4  (REVIEW  AND  FEED- 
BACK), and  after  completion  of  the  request,  control  returns  to  the  discus- 
sion mode. 


C.  DATA  STRUCTURES 

FORUM  maintains  a participant-oriented  global  file  and  two  random- 
access,  mass-storage  files,  one  which  constitutes  the  data  base  for  each  ac- 
tivity and  another  which  contains  an  individual  participants  private  mes- 
sage. The  names  of  these  two  files  are  generated  by  FORUM.  All  control  is 
done  internally  by  the  program,  and  the  user  is  not  aware  of  their  exist- 
ence nor  the  operations  involved  in  "page  mapping",  etc.  The  two  nonglobal 
files  are: 

• an  activity  file,  in  which  all  entries  and  interactions  for  that 
particular  activity  ar^  stored;  which  contains  a master  copy  of 
all  the  items  that  make  up  the  activity;  and  which  contains  per- 
tinent information  on  each  user  in  that  activity  (e.g.,  name; 
history  of  use,  skill  ratings,  and  an  individualized  skeleton  of 
the  conference  items) 

• a private  message  file,  in  which  copies  of  all  private  messages 
sent  and  received  by  the  participant  are  stored 

The  files  are  all  dynamically  expandable;  thus  FORUM  uses  the  space  in  these 
files  only  as  it  is  necessary.  Furthermore,  sir.ee  the  files  in  the  TENEX/ 
PDP-10  environment  are  paged,  the  FORUM  program,  when  loaded  and  running  in 
core,  does  not  need  to  map  in  the  entire  file,  but  rather  only  those  pages 
of  the  file  tnat  are  required.  (An  explanation  of  this  is  given  in  Sec- 
tion D)  . 

When  two  or  more  users  in  a timesharing  environment  independently  de- 
sire to  change  the  contents  of  a common  file,  some  means  must  be  used  to 
insure  that  their  attempted  changes  do  not  interfere  with  one  another.  This 
protection  against  interference  in  other  environments  has  generally  been  ac- 
complished by  giving  the  first  user  wishing  to  make  changes  exclusive  access 
to  the  file.  In  designing  FORUM,  our  desire  was  to  eliminate  this  restric- 
tive, or  "locking-out",  type  of  access.  A data-file  system  which  bypasses 
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the  conventional  file  protocol  was  developed  to  allow  simultaneous  input 
and  retrieval  of  entries  into  the  data  base  by  as  many  users  as  can  use  the 
computer.  % 

The  data-file  system  involves  accessing  a file  in  discrete  pages  and 
mapping  each  page  into  the  user's  memory  space  as  the  need  arises.  Because 
of  the  TENEX  file-sharing  capability,  each  user  can  then  read  from  the  file 
by  reading  his  own  memory  space.  To  ensure  that  users  writing  simultane- 
ously into  the  file  cannot  print  over  each  other's  entries,  the  first  word 
of  each  file  is  used  as  a pointer  to  the  location  of  the  next  free  space  in 
the  file.  Thus,  to  write  into  the  file,  a person's  entry  is  first  buffered 
in  his  own  memory  space  until  it  is  complete.  Then  the  space  for  the  entry 
is  reserved  by  adding  the  length  of  the  entry  to  the  free-space  word  in  one 
machine  instruction.  Finally,  the  entry  is  written  into  the  reserved  space 
without  fear  of  someone  else  writing  in  it  also. 

To  permit  easy  and  efficient  access  to  the  information  stored  in  the 
file,  all  entries  are  indexed  in  a set  of  directories.  Thu  overall  struc- 
ture uses  linked-tree  addressing  to  mirror  the  activity-part  structure, 
while  the  directories  Cor  each  part  of  the  activity  are  linked  directory 
blocks,  each  of  which  stores  relevant  information  on  sixteen  text  entries. 

To  increase  efficiency  further,  these  directories  are  written  together  at 
the  beginning  of  the  file,  while  the  text  entries  are  written  together  start- 
ing at  the  end  of  the  file  and  working  backwards.  This  file  structure  is 
illustrated  in  Figure  22. 

The  global  participant  file  (see  Figures  23  and  24)  contains  informa- 
tion on  all  participants  v/ho  are  known  to  FORUM.  This  information  consists 
of  the  first  and  Last  names,  password,  activity  the  person  may  join,  the 
skill  ratings,  the  last  time  in  FORUM,  as  well  as  the  current  activity  num- 
ber, the  number  of  times  the  person  has  entered  FORUM,  the  directory  from 
which  entry  took  place,  etc.  A hash  table  is  used  to  lead  to  a directory 
for  fast  identification  according  to  a mechanism,  the  details  of  which 
follow. 

Given  a person's  global  participant  number,  a linear  search  down  the 
data  blocks  will  yield  the  corresponding  entry.  Given  the  hash  value  for 
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Figure  24.  Global  Directory 
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the  name,  this  value  module  11  gives  the  location  in  the  hash  table  leading 
tc  the  lookup  directory.  This  directory,  in  turn,  holds  the  relative  loca- 
tion of  the  entry. 

The  private  message  file  is  a two-part  structure  and  is  also  global  for 
a particular  user.  (See  Figure  25.)  It  contains  a set  of  message  direc- 
tories with  information  about  messages  sent  and  received,  and  also  a set  of 
directories  containing  viewing  summaries  (how  many  messages  the  user  has 
actually  seen) . This  file  enables  a user  to  review  and  delete  private  mes- 
sages that  were  sent  as  well  as  those  receiv2d.  The  file  is  deleted  at  the 
end  of  a session  if  there  are  no  messages  in  it  (i.e.,  if  all  have  been 
deleted) . 

The  activity  file  shown  in  Figures  26  through  27  contains  information 
on  the  structure,  of  the  activity,  the  participants  and  their  status  rela- 
tive to  the  activity,  and  the  text  of  the  entries  in  the  activity.  This 
information  is  organized  into  three  parts,  each  with  a directory.  The  con- 
tents directory  shown  :n  Figure  26  points  to  the  information  the  organizer 
entered  when  the  file  was  first  created.  This  includes  the  text  of  the 
parts  and  the  tree-structure  description.  It  is  useful  to  recall  that  each 
par>_  is  a discussion  by  default.  Elicitation  of  special  information  is 
stored  •.-*  a special  kind  of  text  entry. 

To  etv  h part  esponds  a set  of  thirty-eight  information  words  con- 
taining the  joining  and  leaving  bits,  typing  bits,  and  the  numbers  of  up  to 
thirty-six  participants  who  can  be  active  synchronously  in  the  same  part. 

The  text  entry  directory  of  the  activity  file  is  shown  in  Figure  27. 

The  FORUM  input  buffer  is  two  pages  in  length  (or  about  5,000  characters), 
but  there  is  no  limit  to  the  length  of  a file  that  is  submitted  into  an 
activity. 

Several  subdirectories  correspond  tc  each  part.  The  main  directory 
indicates  who  originated  the  entry,  at  what  time,  the  number  of  lines,  and 
the  location  of  the  actual  text  in  the  file.  The  synchronous  directory  is 
written  when  the  entry  is  completed,  and  the  review  directory  is  allocated 
when  the  entry  is  begun.  This  mechanism  is  required  to  support  the  transi- 
tion from  the  asynchornous  to  the  synchronous  interaction  in  a way  that 
remains  invisible  to  the  user. 
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Figure  25  Private  Message  File 
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The  activity  participants  directory  for  each  activity  is  indexed  by 
the  participant's  local  activity  number  and  contains  each  user's  global  par- 
ticipant number,  the  relative  location  of  the  activity  schedule,  the  cur- 
rent participant  number,  the  status  bits,  the  total  number  of  entries  the 
user  has  seen,  and  some  entry  statistics.  The  activity-schedule  information 
is  designed  as  a tree  structure  that  mirrors  that  of  the  activity  and  holds 
the  corresponding  statistics.  (See  Figure  28.) 


P.  ANALYSIS 

This  section  concerns  itself  with  the  actual  operational  performance 
of  FORUM-5  as  a running  program  on  the  PDP-10  computer  at  USC-ISI.  These 
statistics,  based  on  release  5 of  the  program,  can  be  taken  in  most  cases 
as  an  upper  bound  both  in  core  size  and  running  time  with  respect  to  future 
releases . 

In  the  TENEX  PDP-10  environment,  the  computer  and  disk  space  are  divided 
into  pages  of  512  words  of  thirty-six  bits  each.  This  paging  feature  allows 
a more  efficient  use  of  computer  resources  since  sections  of  the  computer 
program  need  only  be  brought  into  core  as  needed.  In  a nonpaged  environ- 
ment, the  entire  program  has  to  reside  in  core. 

Release  5 is  fifty-one  pages  in  length  and  is  reentrant.  These  fifty- 
one  pages  are  divided  into  four  page > of  private  memory  space,  six  pages  of 
shared  files,  and  the  remaining  forty-one  pages  of  pure  computer  instruc- 
tions. By  making  the  program  reentrant  in  this  way,  it  is  possible  (under 
the  TEN’EX  operating  environment'  for  users  to  share  most  of  the  program. 

Thus,  the  first  person  to  use  FORUM  would  need  to  have  the  entire  fifty-one 
pages  of  the  program.  However,  the  next  and  following  users  would  only  need 
an  additional  four  pages  f private  memory  space  cech,  a r they  will  share 
the  files  and  computer  instructions. 

An  important  statistic  for  an  interactive  program  concerns  the  ratio 
of  CPU  usage  to  connect  time.  In  the  case  of  FORUM-5,  this  ratio  is  very 
low.  In  other  words,  the  program  can  run  for  many  hours  while  using  very 
little  computer  time.  Typical  runs  of  FORUM-5  yield  the  figure  of  one  min- 
ute of  computer  time  for  two  hours  of  conferencing  (the  corresponding  cost, 
assuming  standard  industry  rates,  would  be  $1G  for  such  a conference). 
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We  have  obtained  specific  statistics  for  two  users  and  have  averaged 
them  o''or  many  sessions.  User  1 was  running  release  5 at  30  characters  per 
second  through  the  network.  His  CPU/connect  time  ratio,  averaged  over 
eleven  sessions,  is  1/140.  User  2 was  running  release  5 at  240  bharacters 
per  seccud  on  a terminal  that  was  wired  directly  to  the  ISI  machine.  His 
CPU/connect  time  ratio,  averaged  over  twelve  sessions,  is  1/170. 

Another  interesting  statistic  concerns  the  size  of  the  files  generated 
by  FORUM.  We  have  seen  in  Figure  11  the  grov/th  curves  for  two  Institute 
confererces.  The  corresponding  storage  utilization  is  the  following:  At 

the  time  when  the  statistics  were  computed,  there  were  441  entries  in  Con- 
ference #1,  broken  down  into  337  public  entries  and  104  private  messages. 

The  file  size  was  sixty-two  pages,  of  which  the  actual  text  occupied  fifty- 
seven  pages.  There  were  520  entries  in  Conference  #2,  with  431  public  en- 
tries and  89  private  messages.  The  file  size  was  fifty-twc  pages,  with 
forty-six  pages  of  actual  text.  These  figures  are  reflected  in  Figure  29. 

We  have  also  performed  an  analysis  of  the  retrieval  effectiveness  of 
release  5 in  REVIEW  operations.  The  results  are  shown  in  Figures  30  and  31. 

These  statistics  show  a fairly  constant  value  of  9 milliseconds  per  en- 
try in  Conference  #1  for  those  retrieval  requests  that  did  not  require  text 
search.  For  the  requests  that  did  require  text  search  (namely,  requests  such 
as  REVIEW  ENTRIES  RE  "EXPERIMENTS") , the  search  time  is  a function  of  the 
size  of  the  entries  and  the  number  of  characters  in  the  string  to  be  matched. 
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